GGUF model commit (made with llama.cpp commit d96ca7d)

7c0ae0c 11 months ago

.gitattributes

2.22 kB

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago
README.md

21.7 kB

Upload README.md 11 months ago
config.json

26 Bytes

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago
yi-6b-200k.Q2_K.gguf

2.62 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 11 months ago
yi-6b-200k.Q3_K_L.gguf

3.24 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 11 months ago
yi-6b-200k.Q3_K_M.gguf

2.99 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 11 months ago
yi-6b-200k.Q3_K_S.gguf

2.71 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 11 months ago
yi-6b-200k.Q4_0.gguf

3.48 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 11 months ago
yi-6b-200k.Q4_K_M.gguf

3.67 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago
yi-6b-200k.Q4_K_S.gguf

3.5 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago
yi-6b-200k.Q5_0.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago
yi-6b-200k.Q5_K_M.gguf

4.3 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago
yi-6b-200k.Q5_K_S.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago
yi-6b-200k.Q6_K.gguf

4.97 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago
yi-6b-200k.Q8_0.gguf

6.44 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 11 months ago