Darkknight535
/

Moonlight-L3-15B-v2.5-64k

Text Generation

Not-For-All-Audiences

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Darkknight535 commited on 21 days ago

Commit

8b5d6a6

•

1 Parent(s): f05f7d4

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -16,6 +16,10 @@ tags:
   - **Merging**: Merge with lunaris to fix some issues. Note : This model is experimental so feedback is needed.
 ---
 ### Instruct Template
 Default llama3 instruct and context preset, but here is the one i use.
 [Instruct](https://huggingface.co/Darkknight535/OpenCrystal-12B-L3/blob/main/Llama%203%20%5BInstruct%5D.json)

   - **Merging**: Merge with lunaris to fix some issues. Note : This model is experimental so feedback is needed.
 ---
+### Quants (Thanks to mradermacher)
+[Imatrix](https://huggingface.co/mradermacher/Moonlight-L3-15B-v2.5-64k-i1-GGUF)
+[Normal](https://huggingface.co/mradermacher/Moonlight-L3-15B-v2.5-64k-GGUF)
 ### Instruct Template
 Default llama3 instruct and context preset, but here is the one i use.
 [Instruct](https://huggingface.co/Darkknight535/OpenCrystal-12B-L3/blob/main/Llama%203%20%5BInstruct%5D.json)