Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
conversational
Model card Files Community
37

Upload folder using huggingface_hub

#4
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/4
Discussion Files changed
+20
-0
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00005.gguf +3 -0
  3. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00005.gguf +3 -0
  4. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00005.gguf +3 -0
  5. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00004-of-00005.gguf +3 -0
  6. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,8 @@ Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=l
38
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
38
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb42717e65dab202e4967291c7c4bdfe617f96ee1cc2d1b0cbd7e3865c365abf
3
+ size 13522070848
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e205cad17292dbdd048f15c74d3ff3d13551c23cd8de2695f038f76efca1d78f
3
+ size 13193535648
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff9c38e8ebcc2aa118fc3a9e90487372687e64ee4ae2d0a1787f9167204eb8e0
3
+ size 12560359552
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:709918b6cc4b076086d03e943be1e6d149fad7a1962c6f6ff39b9931e5e7a3f7
3
+ size 13347381408
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5c99bb6440fdd473f06e8f9cb22ef1742a3b0202d4affa8dbe0d4b0372c9b41
3
+ size 5610777920