EXL2 quants of Llama2-70B-chat
2.30 bits per weight2.35 bits per weight2.40 bits per weight2.45 bits per weight2.50 bits per weight2.55 bits per weight2.60 bits per weight2.70 bits per weight3.00 bits per weight4.00 bits per weight4.65 bits per weight
measurement.json
-