File size: 650 Bytes
aba1dfa affa97e cb116cc 92a82f9 cb116cc 92a82f9 f9a24f6 92a82f9 6d50fb2 906d8f0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
tags:
- gguf
- GGUF
---
### Host files for a google colab notebook, hoping to make it easier to GGUF models with Imatrix.
# Free Tier Colab
This is only for making the intial FP16 gguf file and computing an imatrix.dat
Quantizing is too slow on colab due to only having two available cores.
# Details
[Thanks to mlabonne for the initial code](https://huggingface.co/mlabonne)
Default Imatrix is from [kalomaze](https://github.com/kalomaze)
RP Imatrix is from [Lewdiculous](https://huggingface.co/Lewdiculous)
Extended is a mix of all data with added alphabets [ParasiticRogue](https://huggingface.co/datasets/ParasiticRogue/Bluemoon-Light) |