README.md

metadata

tags:
  - gguf
  - GGUF

Info

Thanks to mlabonne for the initial code

Host files for a google colab notebook, hoping to make it easier to GGUF models with Imatrix.

There are two imatrix datasets, one for general use and one for RP.

After some testing, making the actual quants is really slow, recommended to only use it for the intial FP16 GGUF and imatrix.dat generation.