Language Support

#2
by ashbo - opened

Hello everyone,
many thanks for this speedy quantization effort. I was wondering which languages you optimized your quantization for.
Will this model support the same 8 languages as Llama-3.1?

Neural Magic org

The quantized model is meant to maintain the support to all languages as the original model. Please report back if you see any performance degradation and we'll be happy to address that.

alexmarques changed discussion status to closed

Sign up or log in to comment