Weni
/

Brain-Llama3.1-1.0.5-SFT-AWQ

4-bit precision

Model card Files Files and versions Community

Brain-Llama3.1-1.0.5-SFT-AWQ / quant_config.json

beamaia's picture

Upload folder using huggingface_hub

54e93cb verified 2 months ago

127 Bytes

{"quant_method": "awq", "zero_point": true, "q_group_size": 128, "w_bit": 4, "version": "gemm", "modules_to_not_convert": null}