File size: 545 Bytes
aba1dfa f9a24f6 92a82f9 f9a24f6 92a82f9 f9a24f6 92a82f9 aba1dfa 75c2758 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
---
tags:
- gguf
- GGUF
---
# HELP WANTED
Does anyone know how to build and host wheels for llama.cpp, but specifically of colab, to avoid wasted time.
# Details
[Thanks to mlabonne for the initial code](https://huggingface.co/mlabonne)
Host files for a google colab notebook, hoping to make it easier to GGUF models with Imatrix.
There are two imatrix datasets, one for general use and one for RP.
After some testing, making the actual quants is really slow, recommended to only use it for the intial FP16 GGUF and imatrix.dat generation. |