Hugging Face's logo

InferenceIllusionist
/
Mistral-Nemo-Instruct-12B-iMat-GGUF

Transformers
GGUF
iMat
Mistral
Inference Endpoints
imatrix
Model card Files Community
InferenceIllusionist commited on
Commit
0cba881
•
1 Parent(s): bad4aef

Upload 6 files

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Mistral-Nemo-Instruct-12B-iMat-IQ4_XS.gguf +3 -0
  3. Mistral-Nemo-Instruct-12B-iMat-Q2_K.gguf +3 -0
  4. Mistral-Nemo-Instruct-12B-iMat-Q3_K_M.gguf +3 -0
  5. Mistral-Nemo-Instruct-12B-iMat-Q3_K_S.gguf +3 -0
  6. Mistral-Nemo-Instruct-12B-iMat-Q4_K_M.gguf +3 -0
  7. Mistral-Nemo-Instruct-12B-iMat-Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -37,3 +37,9 @@ Mistral-Nemo-Instruct-12B-iMat-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
  Mistral-Nemo-Instruct-12B-iMat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
  Mistral-Nemo-Instruct-12B-iMat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  Mistral-Nemo-Instruct-12B-iMat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
37
  Mistral-Nemo-Instruct-12B-iMat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
  Mistral-Nemo-Instruct-12B-iMat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  Mistral-Nemo-Instruct-12B-iMat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mistral-Nemo-Instruct-12B-iMat-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mistral-Nemo-Instruct-12B-iMat-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mistral-Nemo-Instruct-12B-iMat-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mistral-Nemo-Instruct-12B-iMat-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mistral-Nemo-Instruct-12B-iMat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mistral-Nemo-Instruct-12B-iMat-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Nemo-Instruct-12B-iMat-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ef5e92e04ded9d3d2005ced79c01b6b67b3284378208cf85186d165c1a24e1b
3
+ size 6742710176
Mistral-Nemo-Instruct-12B-iMat-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00015cfd8bcc72b3638a051a539686e9c213f4b867cab0f497d06b46f68b7f99
3
+ size 4791048096
Mistral-Nemo-Instruct-12B-iMat-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9ede8ad7e690863ca90cbdf062373c3c288e121421a7206f3a775c045ec268d
3
+ size 6083090336
Mistral-Nemo-Instruct-12B-iMat-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b799e112c303a4cff4507e500445412ed1613dd30d561714aa6bc36da82146ce
3
+ size 5534226336
Mistral-Nemo-Instruct-12B-iMat-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aed2e6d4dfd6736a7c78cb9eaa6020749c3da7fafaaf7e49b83bfb4c37a0e5d0
3
+ size 7477204896
Mistral-Nemo-Instruct-12B-iMat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59c8e2d15eee8d8438a9945ef4db567772523e31d6be0ba610f50698c4d05760
3
+ size 7120197536