neuralmagic/starcoder2-3b-FP8
Text Generation
•
Updated
•
29
Edit Models filters
Active filters:
vllm
neuralmagic/Meta-Llama-3.1-405B-FP8
Text Generation
•
Updated
•
42
bprice9/Palmyra-Medical-70B-FP8
Text Generation
•
Updated
•
21
neuralmagic/gemma-2-2b-it-FP8
Updated
•
347
•
1
neuralmagic/gemma-2-9b-it-quantized.w8a16
Text Generation
•
Updated
•
3.01k
•
1
neuralmagic/gemma-2-2b-it-quantized.w8a16
Text Generation
•
Updated
•
71
•
1
neuralmagic/gemma-2-2b-quantized.w8a16
Text Generation
•
Updated
•
62
neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
58
mradermacher/nemotron-3-8b-chat-4k-sft-hf-i1-GGUF
Updated
•
1.52k
•
2
neuralmagic/gemma-2-2b-it-quantized.w8a8
Text Generation
•
Updated
•
464
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
492
•
2
mradermacher/Nemotron-4-340B-Instruct-hf-GGUF
Updated
•
1
mradermacher/Nemotron-4-340B-Instruct-hf-i1-GGUF
Updated
•
1
mradermacher/Nemotron-4-340B-Base-hf-GGUF
Updated
neuralmagic/SmolLM-360M-Instruct-quantized.w8a8
Text Generation
•
Updated
•
19
neuralmagic/SmolLM-135M-Instruct-quantized.w8a8
Text Generation
•
Updated
•
595
neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
27
mradermacher/Nemotron-4-340B-Base-hf-i1-GGUF
Updated
•
1
cmshin96/MN-12B-Lyra-v3-awq
Text Generation
•
Updated
•
8
cmshin96/MN-12B-Lyra-v1-awq
Text Generation
•
Updated
•
15
cmshin96/MN-12B-Lyra-v4-awq
Text Generation
•
Updated
•
11
LlamaFinetuneBase/Pixtral-12B-2409
Updated
nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf
Text Generation
•
Updated
•
25
soprasteria/Mixtral-8x7B-Instruct-v0.1-FP8
Updated
•
13
TouchNight/Ministral-8B-Instruct-2410-HF
Updated
•
122
TouchNight/Ministral-8B-Instruct-2410-HF-Q5_K_M-GGUF
Updated
•
134
ijohn07/Ministral-8B-Instruct-2410-HF-Q8_0-GGUF
Updated
•
162
adriabama06/reader-lm-1.5b-AWQ
Text Generation
•
Updated
•
61
•
1
sasha0552/Ministral-8B-Instruct-2410
Updated
GrimsenClory/Ministral-8B-Instruct-2410-Q6_K-GGUF
Updated
•
25.4k