Hugging Face's logo

mradermacher
/
giant-hydra-moe-240b-GGUF

Transformers
English
Mixture of Experts
moerge
Inference Endpoints
Model card Files Community
mradermacher commited on
Commit
6977a38
•
1 Parent(s): 988df5e

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -1
README.md CHANGED
@@ -41,7 +41,6 @@ more details, including on how to concatenate multi-part files.
41
  | [P1](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-aa) [P2](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-ab) [P3](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-ac) [P4](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-ad) [P5](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-ae) | Q6_K | 196.3 | very good quality |
42
  | [P1](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-aa) [P2](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-ab) [P3](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-ac) [P4](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-ad) [P5](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-ae) [P6](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-af) | Q8_0 | 253.9 | fast, best quality |
43
 
44
-
45
  Here is a handy graph by ikawrakow comparing some lower-quality quant
46
  types (lower is better):
47
 
 
41
  | [P1](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-aa) [P2](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-ab) [P3](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-ac) [P4](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-ad) [P5](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q6_K.gguf.split-ae) | Q6_K | 196.3 | very good quality |
42
  | [P1](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-aa) [P2](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-ab) [P3](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-ac) [P4](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-ad) [P5](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-ae) [P6](https://huggingface.co/mradermacher/giant-hydra-moe-240b-GGUF/resolve/main/giant-hydra-moe-240b.Q8_0.gguf.split-af) | Q8_0 | 253.9 | fast, best quality |
43
 
 
44
  Here is a handy graph by ikawrakow comparing some lower-quality quant
45
  types (lower is better):
46