YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Synthia-13B EXL2
Weights of Synthia-13B converted to EXL2 format.
Each separate quant is in a different branch, like in The Bloke's GPTQ repos.
export BRANCH=6_0-bpw-h6
git clone --single-branch --branch ${BRANCH} https://huggingface.co/latimar/Synthia-13B-exl2
There are the following branches:
4_625-bpw-h6
6_0-bpw-h6
- Downloads last month
- 9
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.