Llama-3.1 8B quantization?

#1
by ashbo - opened

Hi there,
are there any plans to quantize other Llama-3.1 Models, such as the 8b Variant?

alexmarques changed discussion status to closed

Sign up or log in to comment