Hugging Face's logo

Lewdiculous
/
Kunocchini-7b-128k-test-GGUF-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
Merge
mergekit
Model card Files Community
1
Lewdiculous commited on
Commit
f59dc64
•
1 Parent(s): 1cd4d2a

Add GGUF-Imatrix quants and data.

Browse files
Files changed (11) hide show
  1. .gitattributes +9 -0
  2. Kunocchini-7b-128k-test-IQ3_S-imatrix.gguf +3 -0
  3. Kunocchini-7b-128k-test-Q3_K_M-imatrix.gguf +3 -0
  4. Kunocchini-7b-128k-test-Q4_K_M-imatrix.gguf +3 -0
  5. Kunocchini-7b-128k-test-Q4_K_S-imatrix.gguf +3 -0
  6. Kunocchini-7b-128k-test-Q5_K_M-imatrix.gguf +3 -0
  7. Kunocchini-7b-128k-test-Q5_K_S-imatrix.gguf +3 -0
  8. Kunocchini-7b-128k-test-Q6_K-imatrix.gguf +3 -0
  9. Kunocchini-7b-128k-test-Q8_0-imatrix.gguf +3 -0
  10. imatrix-Kunocchini-7b-128k-test-F16.dat +3 -0
  11. imatrix-base.txt +0 -0
.gitattributes CHANGED
@@ -33,3 +33,12 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix-Kunocchini-7b-128k-test-F16.dat filter=lfs diff=lfs merge=lfs -text
37
+ Kunocchini-7b-128k-test-IQ3_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Kunocchini-7b-128k-test-Q3_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Kunocchini-7b-128k-test-Q4_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Kunocchini-7b-128k-test-Q4_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Kunocchini-7b-128k-test-Q5_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Kunocchini-7b-128k-test-Q5_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Kunocchini-7b-128k-test-Q6_K-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Kunocchini-7b-128k-test-Q8_0-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Kunocchini-7b-128k-test-IQ3_S-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6fce2f11cad39bff5f0e4337fb7c5662de7c2ad310e8239822c64d3248d9071
3
+ size 3182393312
Kunocchini-7b-128k-test-Q3_K_M-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a296c76cf00a00e65c08ae5e36a18b8257e7fe536bcd443a6af02b6be57f956
3
+ size 3518986208
Kunocchini-7b-128k-test-Q4_K_M-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:334f0ba17bbd066575405f4c3448f889dcba26c0b70cfdcf47d93e22c5bcd9da
3
+ size 4368439264
Kunocchini-7b-128k-test-Q4_K_S-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c7a1abd41e3905b78c4702f5220b6b784aded935e44b262badc73604a2f66b4
3
+ size 4140373984
Kunocchini-7b-128k-test-Q5_K_M-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bab205ae64b5ebc9ef1ea55f28bf78a836988069f5204ba66bf7a2b0de9eb27a
3
+ size 5131409376
Kunocchini-7b-128k-test-Q5_K_S-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2a9b7022b08f49e9cd95da01097d83851c556e2e5d8a35c5436e91e1766ba44
3
+ size 4997715936
Kunocchini-7b-128k-test-Q6_K-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:356dea3e2c418794a4d5b64c16e60d8e290c4054182a2e677233a2b4aa48767d
3
+ size 5942065120
Kunocchini-7b-128k-test-Q8_0-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6639e5830eacd503bdef42bd8e53aafb3cca7e52e7c0db189baed4efd6146054
3
+ size 7695857632
imatrix-Kunocchini-7b-128k-test-F16.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d179b065033b9907d09c5b991580d4223bd2ddc75b063afc4a87f6796d8e1fb0
3
+ size 4988126
imatrix-base.txt ADDED
The diff for this file is too large to render. See raw diff