leafspark
/

DeepSeek-V2-Chat-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

DeepSeek-V2-Chat-GGUF

1 contributor

History: 96 commits

leafspark's picture

readme: update quant info; minor changes to hyperlinks and terms

3734c9a verified 4 months ago

DeepSeek-V2-Chat.bf16.gguf
Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub 4 months ago
DeepSeek-V2-Chat.iq2_xxs.gguf
Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub 4 months ago
DeepSeek-V2-Chat.iq3_xs.gguf
Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00008-of-00008.gguf with huggingface_hub 4 months ago
DeepSeek-V2-Chat.q2_k.gguf
tool: add kv overrides to start command (win) 4 months ago
DeepSeek-V2-Chat.q3_k_m.gguf
Add readme for q3_k_m 4 months ago
DeepSeek-V2-Chat.q4_k_m.gguf
Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub 4 months ago
DeepSeek-V2-Chat.q5_k_m.gguf
Create DeepSeek-V2-Chat.q5_k_m.gguf/readme.md 4 months ago
DeepSeek-V2-Chat.q6_k.gguf
Create DeepSeek-V2-Chat.q6_k.gguf/readme.md 4 months ago
DeepSeek-V2-Chat.q8_0.gguf
Upload DeepSeek-V2-Chat.q8_0.gguf/DeepSeek-V2-Chat.Q8_0-00001-of-00012.gguf with huggingface_hub 4 months ago
.gitattributes

6.67 kB

Upload DeepSeek-V2-Chat.q8_0.gguf/DeepSeek-V2-Chat.Q8_0-00001-of-00012.gguf with huggingface_hub 4 months ago
README.md

3.96 kB

readme: update quant info; minor changes to hyperlinks and terms 4 months ago
imatrix.dat

456 MB
LFS

imatrix: add chunk 63 (final) 4 months ago
llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip

25.4 MB
LFS

build: add precompiled llama.cpp 4 months ago