4-bit OmniQuant quantized version of SauerkrautLM-gemma-2-2b-it.
- Downloads last month
- 0
Inference API (serverless) is not available, repository is disabled.
Model tree for numen-tech/SauerkrautLM-gemma-2-2b-it-w4a16g128asym
Base model
VAGOsolutions/SauerkrautLM-gemma-2-2b-it
Quantized
this model