Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation
GGUF
5 languages
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
Model card Files Community
37

Upload folder using huggingface_hub

#29
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/29
Discussion Files changed
+32
-0
Files changed (9) hide show
  1. .gitattributes +8 -0
  2. Mixtral-8x22B-Instruct-v0.1.Q6-00001-of-00004.gguf +3 -0
  3. Mixtral-8x22B-Instruct-v0.1.Q6-00002-of-00004.gguf +3 -0
  4. Mixtral-8x22B-Instruct-v0.1.Q6-00003-of-00004.gguf +3 -0
  5. Mixtral-8x22B-Instruct-v0.1.Q6-00004-of-00004.gguf +3 -0
  6. Mixtral-8x22B-Instruct-v0.1.Q8_0-00001-of-00004.gguf +3 -0
  7. Mixtral-8x22B-Instruct-v0.1.Q8_0-00002-of-00004.gguf +3 -0
  8. Mixtral-8x22B-Instruct-v0.1.Q8_0-00003-of-00004.gguf +3 -0
  9. Mixtral-8x22B-Instruct-v0.1.Q8_0-00004-of-00004.gguf +3 -0
.gitattributes CHANGED
@@ -85,3 +85,11 @@ Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00001-of-00004.gguf filter=lfs diff=lfs merge
85
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
86
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
87
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
85
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
86
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
87
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
88
+ Mixtral-8x22B-Instruct-v0.1.Q6-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
89
+ Mixtral-8x22B-Instruct-v0.1.Q6-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
90
+ Mixtral-8x22B-Instruct-v0.1.Q6-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
91
+ Mixtral-8x22B-Instruct-v0.1.Q6-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
92
+ Mixtral-8x22B-Instruct-v0.1.Q8_0-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
93
+ Mixtral-8x22B-Instruct-v0.1.Q8_0-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
94
+ Mixtral-8x22B-Instruct-v0.1.Q8_0-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
95
+ Mixtral-8x22B-Instruct-v0.1.Q8_0-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-Instruct-v0.1.Q6-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dea804f715df225804f8546aeeeaf72171e70c46d6f1f612dbfdb9a2ec094a81
3
+ size 31024730784
Mixtral-8x22B-Instruct-v0.1.Q6-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e8fe4958617242b433276f69152708c5416bf4371b733c5028234b80f0d71ad
3
+ size 30858864160
Mixtral-8x22B-Instruct-v0.1.Q6-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56660563639721ffb5429e243e10824118750b8d2a3dead666b4d12aee59303d
3
+ size 30858864160
Mixtral-8x22B-Instruct-v0.1.Q6-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecf2e0a60f9663bf7d2e67b8e53a2723ed15bcd92c619af2125bfcb631fbe22c
3
+ size 22795033792
Mixtral-8x22B-Instruct-v0.1.Q8_0-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79e1fd27160a1423a7a1358eca3bb83a48efca7b9e8473202e8fc0a55443c808
3
+ size 40124338848
Mixtral-8x22B-Instruct-v0.1.Q8_0-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2da7cb0485db544d972626729481f5afea71d5d2ebe6d4f797a8c15e89fad165
3
+ size 39909713440
Mixtral-8x22B-Instruct-v0.1.Q8_0-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76e92dfc1050f7355c0a7fdd3cb6eee5147cb3810eaec52750459863207d302c
3
+ size 39909713440
Mixtral-8x22B-Instruct-v0.1.Q8_0-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5b15fc488c62232d0d5691980d7d197f67ad467ec844887d5f6e462c23ccf76
3
+ size 29481082048