Hugging Face's logo

TheBloke
/
Genz-70b-GPTQ

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
4-bit precision
gptq
Model card Files Community
3
New discussion

Can I finetune this quantized model directly?
#3 opened about 1 year ago by dong0213

Error running with Sagemaker Jumpstart + Text Generation Inference : weight model.layers.0.self_attn.rotary_emb.inv_freq does not exist
#2 opened about 1 year ago by bikalnetomi

cannot clone https://huggingface.co/TheBloke/Genz-70b-GPTQ, got killed

1
#1 opened about 1 year ago by fabien-tarrade-axa-ch