mradermacher
/

Vakeel-8B-v2-mini-GGUF

Inference Endpoints

Model card Files Files and versions Community

Vakeel-8B-v2-mini-GGUF

1 contributor

History: 26 commits

mradermacher's picture

uploaded from nethype/kaos

4ddecf3 verified about 2 months ago

.gitattributes

2.3 kB

uploaded from nethype/kaos about 2 months ago
README.md

3.23 kB

auto-patch README.md about 2 months ago
Vakeel-8B-v2-mini.IQ3_M.gguf

853 MB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.IQ3_S.gguf

825 MB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q2_K.gguf

711 MB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q3_K_L.gguf

980 MB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q3_K_M.gguf

905 MB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q3_K_S.gguf

820 MB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q4_K_M.gguf

1.11 GB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q4_K_S.gguf

1.06 GB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q5_K_S.gguf

1.27 GB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q6_K.gguf

1.5 GB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.Q8_0.gguf

1.95 GB
LFS

uploaded from nethype/kaos about 2 months ago
Vakeel-8B-v2-mini.f16.gguf

3.66 GB
LFS

uploaded from nethype/kaos about 2 months ago