nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_channel_weight_static_per_tensor-e2e
Text Generation
•
Updated
•
474
Edit Models filters
Active filters:
compressed-tensors
nm-testing/tinyllama-fp8-dynamic-compressed
Updated
•
242
nm-testing/tinyllama-w4a16-compressed
Updated
•
206
nm-testing/tinyllama-w8a8-compressed
Updated
•
206
nm-testing/tinyllama-w8a16-dense
Updated
•
206
nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight-e2e
Text Generation
•
Updated
•
906
nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group
Text Generation
•
Updated
•
4.08k
nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight
Text Generation
•
Updated
•
17
nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group-e2e
Text Generation
•
Updated
•
944
nm-testing/tinyllama-fp8-dynamic-compressed-hf-quantizer
Updated
•
11
nm-testing/tinyllama-w4a16-compressed-hf-quantizer
Updated
•
7
nm-testing/tinyllama-w8a8-compressed-hf-quantizer
Updated
•
14
nm-testing/tinyllama-w8a16-dense-hf-quantizer
Updated
•
3
nm-testing/DeepSeek-Coder-V2-Lite-Instruct-W8A8
Updated
•
8
nm-testing/DeepSeek-V2.5-W4A16
Updated
•
84
nm-testing/Qwen2-VL-7B-Instruct-FP8-dynamic
Updated
•
128
nm-testing/OLMoE-1B-7B-0924-Instruct-FP8
Updated
•
11
nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf
Text Generation
•
Updated
•
28
nm-testing/tinyllama-oneshot-w8a8-channel-dynamic-token-v2-asym
Updated
•
2.54k
nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Asym-Per-Token-Test
Updated
•
1.14k
•
1
nm-testing/asym-w8w8-int8-static-per-tensor-tiny-llama
Updated
•
2.55k
neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
1.56k
•
1
neuralmagic/Llama-3.2-1B-Instruct-FP8
Text Generation
•
Updated
•
24.9k
•
1
nm-testing/tiny-llama-w4a16-new-key
Updated
•
3
neuralmagic/Llama-3.2-1B-quantized.w8a8
Updated
•
19
neuralmagic/Llama-3.2-3B-quantized.w8a8
Updated
•
22
neuralmagic/Llama-3.2-1B-FP8
Updated
•
78
horheynm/TinyLlama-1.1B-Chat-v1.0-QuantizedCache
Updated
•
1
qeternity/Qwen2.5-72B-Instruct-FP8
Updated
•
6
horheynm/Llama-3.2-11B-Vision-Instruct-FP8-Dynamic
Updated
•
7