1 contributor

History: 7 commits

nisten

uploading 4bit optimal cpu quant and 1bit experimental

5c12184 verified 2 months ago

.gitattributes

4.31 kB

uploading 4bit optimal cpu quant and 1bit experimental 2 months ago
README.md

6.21 kB

Update README.md 2 months ago
deepseek-0628-bf16-00001-of-00011.gguf
45.4 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00002-of-00011.gguf
45.2 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00003-of-00011.gguf
44.8 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00004-of-00011.gguf
45.2 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00005-of-00011.gguf
45.2 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00006-of-00011.gguf
44.8 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00007-of-00011.gguf
45.2 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00008-of-00011.gguf
45.2 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00009-of-00011.gguf
44.8 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00010-of-00011.gguf
44.8 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-bf16-00011-of-00011.gguf
21.3 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-cpu-2bit-IQ2_XXS-00001-of-00002.gguf
45.9 GB
LFS

experimental 2bit 8 bit mixedfatedges quant 2 months ago
deepseek-0628-cpu-2bit-IQ2_XXS-00002-of-00002.gguf
40.6 GB
LFS

experimental 2bit 8 bit mixedfatedges quant 2 months ago
deepseek-0628-cpu-q6k-00001-of-00005.gguf
45.2 GB
LFS

experimental 2bit 8 bit mixedfatedges quant 2 months ago
deepseek-0628-cpu-q6k-00002-of-00005.gguf
45.2 GB
LFS

experimental 2bit 8 bit mixedfatedges quant 2 months ago
deepseek-0628-cpu-q6k-00003-of-00005.gguf
45.2 GB
LFS

experimental 2bit 8 bit mixedfatedges quant 2 months ago
deepseek-0628-cpu-q6k-00004-of-00005.gguf
45 GB
LFS

experimental 2bit 8 bit mixedfatedges quant 2 months ago
deepseek-0628-cpu-q6k-00005-of-00005.gguf
20.3 GB
LFS

experimental 2bit 8 bit mixedfatedges quant 2 months ago
deepseek-0628-q4_0_8_8_faster_dumber-00001-of-00004.gguf
45.3 GB
LFS

experimental dumber4bit but superfast q4_8x8 upload 2 months ago
deepseek-0628-q4_0_8_8_faster_dumber-00002-of-00004.gguf
45.8 GB
LFS

experimental dumber4bit but superfast q4_8x8 upload 2 months ago
deepseek-0628-q4_0_8_8_faster_dumber-00003-of-00004.gguf
44.9 GB
LFS

experimental dumber4bit but superfast q4_8x8 upload 2 months ago
deepseek-0628-q4_0_8_8_faster_dumber-00004-of-00004.gguf
12.7 GB
LFS

experimental dumber4bit but superfast q4_8x8 upload 2 months ago
deepseek-0628-q8_0-00001-of-00006.gguf
45.3 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-q8_0-00002-of-00006.gguf
45.1 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-q8_0-00003-of-00006.gguf
44.9 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-q8_0-00004-of-00006.gguf
45.1 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-q8_0-00005-of-00006.gguf
45.1 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek-0628-q8_0-00006-of-00006.gguf
25.1 GB
LFS

bf16 & 8bit upload of DeepSeek 0628 GGUF model 2 months ago
deepseek_0628_cpu-iq1m-00001-of-00002.gguf
46 GB
LFS

uploading 4bit optimal cpu quant and 1bit experimental 2 months ago
deepseek_0628_cpu-iq1m-00002-of-00002.gguf
32.7 GB
LFS

uploading 4bit optimal cpu quant and 1bit experimental 2 months ago
deepseek_0628_cpu_optimized_iq4xm-00001-of-00004.gguf
45.5 GB
LFS

uploading 4bit optimal cpu quant and 1bit experimental 2 months ago
deepseek_0628_cpu_optimized_iq4xm-00002-of-00004.gguf
45.5 GB
LFS

uploading 4bit optimal cpu quant and 1bit experimental 2 months ago
deepseek_0628_cpu_optimized_iq4xm-00003-of-00004.gguf
45.3 GB
LFS

uploading 4bit optimal cpu quant and 1bit experimental 2 months ago
deepseek_0628_cpu_optimized_iq4xm-00004-of-00004.gguf
5.56 GB
LFS

uploading 4bit optimal cpu quant and 1bit experimental 2 months ago
imatrix-0628-bf16.dat
456 MB
LFS

uploading 4bit optimal cpu quant and 1bit experimental 2 months ago
imatrix_groups_m.txt

201 kB

experimental 2bit 8 bit mixedfatedges quant 2 months ago
wiki.test.raw

1.29 MB

experimental 2bit 8 bit mixedfatedges quant 2 months ago