Hugging Face's logo

AuriAetherwiing
/
magnum-72b-v1-fp8-dynamic

Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Inference Endpoints
fp8
Model card Files Community
Auri commited on
Commit
ef5f346
•
1 Parent(s): 23ed2b7

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md ADDED
@@ -0,0 +1 @@
 
 
1
+ Dynamic FP8 quant of [Magnum 72B v1](https://huggingface.co/anthracite-org/magnum-72b-v1) made with AutoFP8. Quant was requested by InfermaticAI.