Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

55

Full-text search

Active filters: 7-bit

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_7.0bpw_h8

Text Generation • Updated Jul 30 • 6

SicariusSicariiStuff/2B_or_not_2B-EXL2-7.0bpw

Updated Aug 11 • 2

SicariusSicariiStuff/Dusk_Rainbow-EXL2-7.0-bpw

Updated Aug 17 • 2

SicariusSicariiStuff/KoboldAI_LLaMA2-13B-Psyfighter2-EXL2-7.0bpw

Updated Aug 20 • 3

SicariusSicariiStuff/PygmalionAI_pygmalion-7b-EXL2-7.0bpw

Text Generation • Updated Aug 20 • 2

SicariusSicariiStuff/Phi-3.5-mini-instruct_Uncensored-EXL2-7.0bpw

Text Generation • Updated Sep 10 • 4

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.0bpw_h8

Text Generation • Updated Aug 22

bigstorm/Hermes-3-Llama-3.1-70B-7.0bpw-8hb-exl2

Updated Aug 26 • 2

SicariusSicariiStuff/2B-ad-EXL2-7.0bpw

Updated Aug 26 • 6

bigstorm/dolphin-2.9.4-llama3.1-8b-7.0bpw-8hb-exl2

Updated Aug 28 • 8

BigHuggyD/c4ai-command-r-plus-08-2024_exl2_7.0bpw_h8

Text Generation • Updated Aug 31 • 4

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_7.0bpw_h8

Text Generation • Updated Sep 7 • 9 • 1

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-7.0bpw

Updated Sep 11 • 4

DrNicefellow/Qwen2.5-32B-Instruct-7.0bpw-exl2

Updated Sep 19 • 4

DrNicefellow/Qwen2.5-7B-Instruct-7.0bpw-exl2

DrNicefellow/Qwen2.5-14B-Instruct-7.0bpw-exl2

Updated Sep 20 • 8

bigstorm/Qwen2.5-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Sep 20 • 13

DrNicefellow/Qwen2.5-Coder-7B-Instruct-7.0bpw-exl2

Updated Sep 21 • 1

DrNicefellow/Qwen2.5-Math-7B-Instruct-7.0bpw-exl2

BigHuggyD/gghfez_SmartMaid-123b_exl2_7.0bpw_h8

Updated Sep 28 • 4

SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-7.0bpw

Updated Oct 1 • 6

BigHuggyD/TheDrummer_Behemoth-123B-v1_exl2_7.0bpw_h8

Updated about 1 month ago • 13

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-7.0-bpw

Updated 30 days ago • 10

schnapper79/lumikabra-behemoth-123b-exl2-7.0bpw

Text Generation • Updated 27 days ago • 19

BigHuggyD/TheDrummer_Behemoth-123B-v1.1_exl2_7.0bpw_h6

Updated 13 days ago • 4