Edit Models filters

Inference status

Misc

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

283

Full-text search

Active filters: web-llm

mlc-ai/phi-2-q4f16_1-MLC

Updated Jul 11 • 464 • 2

mlc-ai/phi-1_5-q0f16-MLC

mlc-ai/phi-1_5-q4f16_1-MLC

Updated Jul 11 • 145

mlc-ai/gpt2-q0f16-MLC

Updated Jul 11 • 3

mlc-ai/gpt2-medium-q0f16-MLC

Updated Jul 11 • 8

mlc-ai/Mistral-7B-Instruct-v0.2-q3f16_1-MLC

Updated Jul 11 • 111 • 4

mlc-ai/TinyLlama-1.1B-Chat-v0.4-q4f16_1-MLC

Updated Jul 11 • 220 • 1

mlc-ai/TinyLlama-1.1B-Chat-v0.4-q4f32_1-MLC

Updated Jul 11 • 1.7k • 1

mlc-ai/TinyLlama-1.1B-Chat-v0.4-q0f16-MLC

Updated Jul 11 • 12

mlc-ai/TinyLlama-1.1B-Chat-v0.4-q0f32-MLC

Updated Jul 11 • 1

mlc-ai/phi-1_5-q0f32-MLC

Updated Jul 11 • 6

mlc-ai/phi-1_5-q4f32_1-MLC

Updated Jul 11 • 34 • 1

mlc-ai/phi-2-q0f32-MLC

Updated Jul 11 • 3

mlc-ai/phi-2-q4f32_1-MLC

Updated Jul 11 • 322 • 1

mlc-ai/NeuralHermes-2.5-Mistral-7B-q3f16_1-MLC

Updated Jul 11 • 3

mlc-ai/Qwen-7B-Chat-q4f16_1-MLC

Updated Jul 11 • 7 • 2

mlc-ai/Qwen-7B-Chat-q4f32_1-MLC

Updated Jul 11 • 2

mlc-ai/Qwen-1_8B-Chat-q4f16_1-MLC

Updated Jul 11 • 15 • 1

mlc-ai/Qwen-1_8B-Chat-q4f32_1-MLC

Updated Jul 11 • 5 • 1

mlc-ai/Qwen-14B-Chat-q4f32_1-MLC

Updated Jul 11 • 1

mlc-ai/CodeLlama-7b-hf-q4f16_1-MLC

Updated Jul 11 • 3

mlc-ai/CodeLlama-7b-hf-q4f32_1-MLC

Updated Jul 11 • 9

mlc-ai/CodeLlama-13b-hf-q4f16_1-MLC

Updated Jul 11 • 4

mlc-ai/CodeLlama-13b-hf-q4f32_1-MLC

Updated Jul 11 • 3

mlc-ai/CodeLlama-34b-hf-q4f16_1-MLC

mlc-ai/CodeLlama-34b-hf-q4f32_1-MLC

Updated Jul 11 • 1

mlc-ai/CodeLlama-7b-Instruct-hf-q4f16_1-MLC

mlc-ai/CodeLlama-7b-Instruct-hf-q4f32_1-MLC

Updated Jul 11 • 1

mlc-ai/CodeLlama-13b-Instruct-hf-q4f16_1-MLC

Updated Jul 11 • 2

mlc-ai/CodeLlama-13b-Instruct-hf-q4f32_1-MLC

Updated Jul 11 • 2