The Minitron Models and Their Teachers, Quantized - a kaitchup Collection

kaitchup 's Collections

Qwen2.5 Quantized

Opus Translation Datasets

GPTQ

Yi

Contaminated Mistral 7B and TinyLlama

Llama 3 70B ExLlamaV2 (bpw: 4.0, 3.5, 3.0, 2.5, and 2.18)

[Basics] Quantized Phi-3

[Basics] AutoRound: Llama 3

Quantized Llama 3.1

The Minitron Models and Their Teachers, Quantized

Minivoc

The Minitron Models and Their Teachers, Quantized

updated Aug 26

kaitchup/Mistral-NeMo-Minitron-8B-Base-AutoRound-GPTQ-sym-4bit

Text Generation • Updated Aug 27 • 17
kaitchup/Mistral-NeMo-Minitron-8B-Base-AutoRound-GPTQ-asym-4bit

Text Generation • Updated Aug 26 • 47
kaitchup/Mistral-Nemo-Base-2407-AutoRound-GPTQ-asym-4bit

Text Generation • Updated Aug 26 • 35
kaitchup/Llama-3.1-Minitron-4B-Width-Base-AutoRound-GPTQ-asym-4bit

Text Generation • Updated Aug 26 • 12
kaitchup/Meta-Llama-3.1-8B-AutoRound-GPTQ-asym-4bit

Text Generation • Updated Aug 26 • 17
kaitchup/Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-asym-4bit

Text Generation • Updated Aug 26 • 17
kaitchup/Llama-3.1-Minitron-4B-Width-Base-AutoRound-GPTQ-sym-4bit

Text Generation • Updated Aug 26 • 10
kaitchup/Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-sym-4bit

Text Generation • Updated Aug 26 • 17
kaitchup/Mistral-Nemo-Base-2407-AutoRound-GPTQ-sym-4bit

Text Generation • Updated Aug 26 • 15
kaitchup/Meta-Llama-3.1-8B-AutoRound-GPTQ-sym-4bit

Text Generation • Updated Aug 26 • 11