| license: llama3.2 | |
| base_model: | |
| - meta-llama/Llama-3.2-1B-Instruct | |
| pipeline_tag: text-generation | |
| tags: | |
| - GPTQ | |
| - 8bit | |
| - 128g | |
| - 1B | |
| - llama | |
| - meta | |
| - llama-3 | |
| - conversational | |
| language: | |
| - en | |
| - de | |
| - fr | |
| - it | |
| - pt | |
| - hi | |
| - es | |
| - th | |
| GPTQ Version of [meta-llama/Llama-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B): 8 bit, 128 groupsize | |
| ✅ Tested on vLLM |