Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

16,986

Full-text search

Active filters: 4-bit

tiiuae/falcon-mamba-7b-4bit

Text Generation • Updated Oct 10 • 150 • 11

unsloth/Mistral-Large-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 324 • 9

shuyuej/Mistral-Large-Instruct-2407-GPTQ

Text Generation • Updated Jul 25 • 374 • 3

TechxGenus/Mistral-Large-Instruct-2407-AWQ

Text Generation • Updated Oct 11 • 6.7k • 9

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25 • 681 • 4

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 175 • 3

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 20 days ago • 8.77k • 21

lucyknada/NeverSleep_Lumimaid-v0.2-12B-exl2-4.0bpw

Text Generation • Updated Jul 26 • 21 • 1

shuyuej/bge-en-icl-GPTQ

Feature Extraction • Updated Jul 29 • 52 • 1

shuyuej/bge-multilingual-gemma2-GPTQ

Feature Extraction • Updated Jul 29 • 214 • 4

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3 • 7.29k • 13

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 15.8k • 25

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Sep 25 • 74.1k • 64

zero-systems/Artemis-Extactor-70B-4bit-gptq-v1

Updated Sep 6 • 1 • 1

solidrust/dolphin-2.9.4-llama3.1-8b-AWQ

Text Generation • Updated Sep 3 • 119 • 3

PrunaAI/THUDM-LongWriter-glm4-9b-bnb-4bit-smashed

Updated Aug 16 • 41 • 2

SicariusSicariiStuff/Dusk_Rainbow-EXL2-4.0-bpw

Updated Aug 17 • 15 • 1

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17 • 8 • 6

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 1.01M • 7

alicekyting/whisper-large-v3-4bit

Automatic Speech Recognition • Updated Aug 22 • 19 • 1

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 1.25M • 4

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Aug 20 • 73.7k • 10

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22 • 1.09k • 3

Statuo/NemoMix-Unleashed-EXL2-4bpw

Text Generation • Updated Aug 23 • 132 • 6

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 1.15k • 34

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25 • 64 • 7

team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 1.05k • 2

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 122 • 3

team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-GPTQ-4bit

Text Generation • Updated Sep 3 • 256 • 1

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-GPTQ-4bit

Text Generation • Updated Sep 3 • 253 • 2