Lewdiculous
/

Infinitely-Laydiculous-9B-GGUF-IQ-Imatrix

Inference Endpoints

Model card Files Files and versions Community

Lewdiculous commited on Mar 14

Commit

e994792

•

1 Parent(s): dc11026

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -33,8 +33,8 @@ Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
 **Quants:**
 ```python
     quantization_options = [
-        "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S", "Q6_K",
-        "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
     ]
 ```

 **Quants:**
 ```python
     quantization_options = [
+        "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
+        "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
     ]
 ```