Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Quant-Cartel
/
Cerebrum-1.0-8x7b-iMat-GGUF
like
3
Follow
Quant Cartel
16
GGUF
GGUF
Merge
iMat
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Deploy
Use this model
main
Cerebrum-1.0-8x7b-iMat-GGUF
1 contributor
History:
16 commits
InferenceIllusionist
Added t/s benchmark, updated sizes, fixed tables
cf48ee0
verified
7 months ago
.gitattributes
Safe
2.22 kB
Upload Cerebrum-1.0-8x7b-iMat-IQ2_S.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-IQ2_M.gguf
Safe
15.5 GB
LFS
Upload Cerebrum-1.0-8x7b-iMat-IQ2_M.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-IQ2_S.gguf
Safe
14.1 GB
LFS
Upload Cerebrum-1.0-8x7b-iMat-IQ2_S.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-IQ3_M.gguf
Safe
21.4 GB
LFS
Upload Cerebrum-1.0-8x7b-iMat-IQ3_M.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-IQ3_S.gguf
Safe
20.4 GB
LFS
Upload Cerebrum-1.0-8x7b-iMat-IQ3_S.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-IQ3_XS.gguf
Safe
19.3 GB
LFS
Rename Cerebrum-1.0-8x7b-IQ3_XS.gguf to Cerebrum-1.0-8x7b-iMat-IQ3_XS.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-IQ3_XXS.gguf
Safe
18.2 GB
LFS
Upload Cerebrum-1.0-8x7b-iMat-IQ3_XXS.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-IQ4_XS.gguf
Safe
25.1 GB
LFS
Upload Cerebrum-1.0-8x7b-iMat-IQ4_XS.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-Q4_K_M.gguf
Safe
28.4 GB
LFS
Upload Cerebrum-1.0-8x7b-iMat-Q4_K_M.gguf
8 months ago
Cerebrum-1.0-8x7b-iMat-Q5_K_M.gguf
Safe
33.2 GB
LFS
Upload Cerebrum-1.0-8x7b-iMat-Q5_K_M.gguf
8 months ago
README.md
Safe
15.6 kB
Added t/s benchmark, updated sizes, fixed tables
7 months ago
