Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+mahou-1.5-mistral-nemo-12b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+mahou-1.5-mistral-nemo-12b.bf16.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,49 @@
+---
+base_model:
+- flammenai/Flammades-Mistral-Nemo-12B
+datasets:
+- flammenai/MahouMix-v1
+library_name: transformers
+license: apache-2.0
+tags:
+- autoquant
+- gguf
+---
+![image/png](https://huggingface.co/flammenai/Mahou-1.0-mistral-7B/resolve/main/mahou1.png)
+
+# Mahou-1.5-mistral-nemo-12B
+
+Mahou is designed to provide short messages in a conversational context. It is capable of casual conversation and character roleplay.
+
+### Chat Format
+
+This model has been trained to use ChatML format.
+
+```
+<|im_start|>system
+{{system}}<|im_end|>
+<|im_start|>{{char}}
+{{message}}<|im_end|>
+<|im_start|>{{user}}
+{{message}}<|im_end|>
+```
+
+### Roleplay Format
+
+- Speech without quotes.
+- Actions in `*asterisks*`
+
+```
+*leans against wall cooly* so like, i just casted a super strong spell at magician academy today, not gonna lie, felt badass.
+```
+
+### SillyTavern Settings
+
+1. Use ChatML for the Context Template.
+2. Enable Instruct Mode.
+3. Use the [Mahou ChatML Instruct preset](https://huggingface.co/datasets/flammenai/Mahou-ST-ChatML-Instruct/raw/main/Mahou.json).
+4. Use the [Mahou Sampler preset](https://huggingface.co/datasets/flammenai/Mahou-ST-Sampler-Preset/raw/main/Mahou.json).
+
+### Method
+
+[ORPO finetuned](https://mlabonne.github.io/blog/posts/2024-04-19_Fine_tune_Llama_3_with_ORPO.html) with 4x H100 for 3 epochs.

mahou-1.5-mistral-nemo-12b.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a3520c2b6da0877db057c4d0dda1987579d5b7b2b92819c3de4e14ec8dbe166
+size 4791047360

mahou-1.5-mistral-nemo-12b.bf16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:541b7b748ddd409892649021ded21bddda598fb7ad0fa11ebe4b722b7084187d
+size 24504276160