base_model: | |
- jinaai/reader-lm-1.5b | |
pipeline_tag: text-generation | |
language: | |
- multilingual | |
inference: false | |
license: cc-by-nc-4.0 | |
library_name: transformers | |
tags: | |
- vllm | |
AWQ Version of [jinaai/reader-lm-1.5b](https://huggingface.co/jinaai/reader-lm-1.5b): 4 bit, 128 groupsize | |
✅ Tested on vLLM |