allura-org
/

MoE-Girl-1BA-7BT

Text Generation

Mixture of Experts

Inference Endpoints

Model card Files Files and versions Community

Fizzarolli commited on 29 days ago

Commit

1d08343

•

1 Parent(s): 3da4a49

Update README.md

Files changed (1) hide show

README.md +5 -0

README.md CHANGED Viewed

@@ -17,6 +17,11 @@ A finetune of OLMoE by AllenAI designed for roleplaying (and maybe general useca
 ## Disclaimer
 PLEASE do not expect godliness out of this, it's a model with 1 billion active parameters. Expect something more akin to Gemma 2 2B, not Llama 3 8B.
 ## Prompting
 Use ChatML.
 ```

 ## Disclaimer
 PLEASE do not expect godliness out of this, it's a model with 1 billion active parameters. Expect something more akin to Gemma 2 2B, not Llama 3 8B.
+## Quants
+GGUF:
+- [mradermacher's imatrix quants](https://huggingface.co/mradermacher/MoE-Girl-1BA-7BT-i1-GGUF)
+- [our static quants](https://huggingface.co/allura-org/MoE-Girl-1BA-7BT-GGUF)
 ## Prompting
 Use ChatML.
 ```