File size: 871 Bytes
9d22ae1 611461e 7a0a1a8 9d22ae1 611461e 37b183f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
---
license: cc-by-nc-2.0
pipeline_tag: text-generation
library_name: transformers
---
## GGUF Quantizations of laserxtral
Join Our Discord! https://discord.gg/vT3sktQ3zb
This repo contains GGUF format model files for our laserxtral model.
*To Manual Downloaders* You will generally not want to download the whole repository. Select the file name from the list below and use your downloader of choice.
## Provided files
| Name | Quant method | Bits | Size |
| ---- | ---- | ---- | ---- |
| [cognitivecomputations_laserxtral-Q2_K.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q2_K.gguf) | Q2_K | 2 | 8.8 GB |
| [cognitivecomputations_laserxtral-Q4_K_M.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q4_K_M.gguf) | Q4_K_M | 4 | 14.6 GB | |