Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

11,179

Full-text search

Active filters: bitsandbytes

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Sep 25 • 19.4k • 39

theprint/ReWiz-Qwen-2.5-14B

Text Generation • Updated 4 days ago • 230 • 4

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 1.39k • 23

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 18.9k • 24

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 3 • 12.9k • 25

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 18.5k • 22

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Sep 25 • 71.3k • 64

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22 • 1.07k • 3

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25 • 56 • 7

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 5.45k • 6

sayakpaul/sd35-large-nf4

Text-to-Image • Updated 13 days ago • 4

thwin27/Aria-sequential_mlp-bnb_nf4

Image-Text-to-Text • Updated 17 days ago • 478 • 8

imnotednamode/mochi-1-preview-mix-nf4-small

Updated about 4 hours ago • 31 • 2

collaiborateorg/Bio-ChEMBL-MolGen-Llama-3-2-1B-V1

Updated about 10 hours ago • 2 • 2

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9 • 445 • 7

ybelkada/Mixtral-8x7B-Instruct-v0.1-bnb-4bit

Text Generation • Updated Jan 12 • 123 • 59

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11 • 10.5k • 24

stillerman/starcoder-mathematica

Updated Jan 22 • 5 • 1

devlocalhost/blip2-opt-2.7b-xray-captions

Visual Question Answering • Updated Feb 11 • 23 • 1

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 999 • 22

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated Sep 26 • 11 • 5

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16 • 123 • 9

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27 • 733 • 171

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21 • 3 • 1

ikeno-ada/madlad400-3b-mt-bitsandbytes-4bit

Translation • Updated Apr 3 • 154 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27 • 351 • 246

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5 • 78 • 1

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 95 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11 • 5 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 19 days ago • 207k • 181