TheDrummer
/

Cydonia-22B-v1.1-GGUF

Inference Endpoints

Model card Files Files and versions Community

TheDrummer commited on Sep 29

Commit

9433592

•

1 Parent(s): f26213b

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -22,8 +22,8 @@ license: other
 ## Links
 - Original: https://huggingface.co/TheDrummer/Cydonia-22B-v1.1
 - GGUF: https://huggingface.co/TheDrummer/Cydonia-22B-v1.1-GGUF
-- iMatrix: TBD (recommended for lower quants like Q2, maybe Q3)
-- EXL2: TBD
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/A67a5B4kOqv6JZUQmYCGQ.png)

 ## Links
 - Original: https://huggingface.co/TheDrummer/Cydonia-22B-v1.1
 - GGUF: https://huggingface.co/TheDrummer/Cydonia-22B-v1.1-GGUF
+- iMatrix: https://huggingface.co/bartowski/Cydonia-22B-v1.1-GGUF (recommended for lower quants)
+- EXL2: [8bpw](https://huggingface.co/Statuo/MS-Cydonia-V1.1-EXL2-8bpw), [6bpw](https://huggingface.co/Statuo/MS-Cydonia-V1.1-EXL2-6bpw), [4bpw](https://huggingface.co/Statuo/MS-Cydonia-V1.1-EXL2-4bpw)
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/A67a5B4kOqv6JZUQmYCGQ.png)