4bit Instruct Models - a unsloth Collection

unsloth 's Collections

Llama 3.2 All Versions

Load 4bit models 4x faster

4bit Instruct Models

4bit Instruct Models

updated 28 days ago

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 277k • 12
unsloth/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 96.8k • 9
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Sep 25 • 19.4k • 39
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Sep 11 • 462k • 37
unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 87.8k • 128
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 18.5k • 22
unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3 • 10.9k • 24
unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 18.9k • 24
unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Sep 3 • 25.8k • 19
unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Sep 11 • 15.8k • 31
unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Sep 11 • 146k • 15
unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 1.93k • 41
unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3 • 4.18k • 4
unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3 • 3.44k • 13
unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3 • 1.07k • 18
unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 4 • 1.43k • 3
unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4 • 158
unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4 • 2.99k • 2