TheBloke
/

zephyr-7B-beta-AWQ

Text Generation

Generated from Trainer

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

vLLM out of memory

#2 opened 12 months ago by

Is there a way to finetune these AWQ beasts?

#1 opened 12 months ago by