Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
FimbulHermes-15B-v0.1 EXL2 6.5bpw
This is a 6.5bpw quant of steinzer-narayan/fimbulhermes-15B-v0.1_exl2_6.5bpw.
- Downloads last month
- 4
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.