Update README.md

README.md

@@ -9,7 +9,6 @@ tags:
   - storywriting
   - finetuned
   - not-for-all-audiences
-  - gguf
 base_model: KoboldAI/LLaMA2-13B-Psyfighter2
 model_type: llama
 prompt_template: >
@@ -27,15 +26,17 @@ prompt_template: >
 
 # Model Card for Psyfighter2-13B-vore
 
-This is a version of [LLaMA2-13B-Psyfighter2](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2) finetuned to better understand vore context. The primary purpose of this model is to be a storywriting assistant, as well as a conversational model in a chat.
+This model is a version of [KoboldAI/LLaMA2-13B-Psyfighter2](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2) finetuned to better understand vore context. The primary purpose of this model is to be a storywriting assistant, as well as a conversational model in a chat.
 
 The Adventure Mode is still work in progress, and will be added later.
 
+Download the quantized version of this model here: [SnakyMcSnekFace/Psyfighter2-13B-vore-GGUF](https://huggingface.co/SnakyMcSnekFace/Psyfighter2-13B-vore-GGUF)
+
 ## Model Details
 
 ### Model Description
 
-The model behaves similarly to `LLaMA2-13B-Psyfighter2`, which it was derived from. Please [see the README.md here](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2/blob/main/README.md) to learn more.
+The model behaves similarly to `KoboldAI/LLaMA2-13B-Psyfighter2`, which it was derived from. Please [see the README.md here](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2/blob/main/README.md) to learn more.
 
 This model was fine-tuned on ~55 MiB of free-form text, containing stories focused around the vore theme. As a result, it has a strong vorny bias.
 
@@ -52,16 +53,16 @@ In the chat mode, if the conversation is not going where you would like it to go
 The easiest way to try out the model is [Koboldcpp Colab Notebook](https://colab.research.google.com/github/lostruins/koboldcpp/blob/concedo/colab.ipynb). This method doesn't require you to have a powerful graphics card.
 
 - Open the notebook
-- Paste the model URL into the field: `https://huggingface.co/SnakyMcSnekFace/Psyfighter2-13B-vore/resolve/main/Psyfighter2-13B-vore_q4_k_m.gguf`
+- Paste the model URL into the field: `https://huggingface.co/SnakyMcSnekFace/Psyfighter2-13B-vore-GGUF/resolve/main/Psyfighter2-13B-vore.Q4_K_M.gguf`
 - Start the notebook, wait for the URL to CloudFlare tunnel to appear at the bottom and click it
 - Use the model as a writing assistant
 - You can try an adventure from [https://aetherroom.club/](https://aetherroom.club/), but keep in mind that the model will not let you take turn unless you stop it. Adventure mode is work-in-progress.
 
 ### Faraday 
 
-Another convenient way to use the model is [Faraday.dev](https://faraday.dev/) application, which allows you to run the model locally on your computer. You'll need a graphics card with at least 8GB VRAM to use this method comfortably.
+Another convenient way to use the model is [Faraday.dev](https://faraday.dev/) application, which allows you to run the model locally on your computer. You'll need a graphics card with at least 8GB VRAM to use `Q4_K_M` version comfortably, and 16GB VRAM for `Q8_0`. (`Q4_K_M` version is smaller and faster, `Q8_0` is slower but more coherent.)
 
-Download the [Psyfighter2-13B-vore_q4_k_m.gguf](https://huggingface.co/SnakyMcSnekFace/Psyfighter2-13B-vore/resolve/main/Psyfighter2-13B-vore_q4_k_m.gguf) file into `%appdata%\faraday\models` folder on your computer. The model should appear in `Manage Models` menu under `Downloaded Models`. You can then select it in your character card or set it as a default model.
+Download the [Psyfighter2-13B-vore.Q4_K_M.gguf](https://huggingface.co/SnakyMcSnekFace/Psyfighter2-13B-vore-GGUF/resolve/main/Psyfighter2-13B-vore.Q4_K_M.gguf) or [Psyfighter2-13B-vore.Q8_0.gguf](https://huggingface.co/SnakyMcSnekFace/Psyfighter2-13B-vore-GGUF/resolve/main/Psyfighter2-13B-vore.Q8_0.gguf) file into `%appdata%\faraday\models` folder on your computer. The model should appear in `Manage Models` menu under `Downloaded Models`. You can then select it in your character card or set it as a default model.
 
 ### Others
 
@@ -92,8 +93,6 @@ Training parameters:
 - Sample size: 768 tokens
 - Samples per epoch: 47420
 - Number of epochs: 2
-- Batch size: 1
-- Gradient accumulation steps: 16
 - First epoch: Learning rate = 3e-4, 1000 steps warmup, cosine schedule
 - Second epoch: Learning rate = 1e-4, 256 steps warmup, inverse sqrt schedule