Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
helloollel
/
llama3.1_quantization
like
0
Transformers
GGUF
English
llama
text-generation-inference
unsloth
Inference Endpoints
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
llama3.1_quantization
1 contributor
History:
8 commits
helloollel
Update README.md
9bf8ea0
verified
3 months ago
.gitattributes
Safe
1.74 kB
(Trained with Unsloth)
3 months ago
README.md
Safe
572 Bytes
Update README.md
3 months ago
config.json
Safe
29 Bytes
(Trained with Unsloth)
3 months ago
unsloth.BF16.gguf
Safe
16.1 GB
LFS
(Trained with Unsloth)
3 months ago
unsloth.Q4_K_M.gguf
Safe
4.92 GB
LFS
(Trained with Unsloth)
3 months ago
unsloth.Q5_K_M.gguf
Safe
2.2 GB
LFS
(Trained with Unsloth)
3 months ago
unsloth.Q8_0.gguf
Safe
8.54 GB
LFS
(Trained with Unsloth)
3 months ago