Commit
•
0870fbe
1
Parent(s):
6782c84
Add: New Q4 quant-types, great results and much smaller sizes! IQ4_NL and IQ4_XS
Browse files
.gitattributes
CHANGED
|
@@ -53,3 +53,5 @@ v2_Kunocchini-7b-128k-test-Q5_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -te
|
|
| 53 |
v2_Kunocchini-7b-128k-test-Q5_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
v2_Kunocchini-7b-128k-test-Q6_K-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
| 55 |
v2_Kunocchini-7b-128k-test-Q8_0-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 53 |
v2_Kunocchini-7b-128k-test-Q5_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
v2_Kunocchini-7b-128k-test-Q6_K-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
| 55 |
v2_Kunocchini-7b-128k-test-Q8_0-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
| 56 |
+
v2_Kunocchini-7b-128k-test-IQ4_NL-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
| 57 |
+
v2_Kunocchini-7b-128k-test-IQ4_XS-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
v2_Kunocchini-7b-128k-test-IQ4_NL-imatrix.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1acc86a04a995851982c49cb51a9a60ff76b22dc0c12319defece68dda957f9b
|
| 3 |
+
size 4125694112
|
v2_Kunocchini-7b-128k-test-IQ4_XS-imatrix.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dcfc9b46d290ef8d2a0eee88f7d9fab8575ad2f8efdc55c4517a320a4e66dfc0
|
| 3 |
+
size 3907688608
|