unsloth

/

Meta-Llama-3.1-70B-Instruct-bnb-4bit

like 16

How did you make these weights? Did you use a particular script based on PyTorch and BitsAndBytes?

We used bitsandbytes yes!

Thanks @shimmyshimmer :) Is this script on GitHub anywhere? Are you able to share it? I have older hardware but I would still like to try to produce these weights.