File size: 265 Bytes
1013809
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
---
datasets:
- Norquinal/claude_multiround_chat_1k
---

AWQ quant with `pileeval` of [Norquinal/Mistral-7B-claude-chat](https://huggingface.co/Norquinal/Mistral-7B-claude-chat)

```json
{ "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
```