Q6_K and Q8_0 Quantization.
#2
by
Haiart
- opened
Hello Herman555, thank you for the model, I am having much fun with it.
Could you please upload the Q6_K and Q8_0 quantization? If not possible for both, only the Q6_K? Thanks again.
Hello!. Both will be uploaded, you can expect it to be up in about 30 to 60 minutes.
Took a little longer due to an error while uploading but both files are up now.
No worries, I got them already, thank you so much.
Herman555
changed discussion status to
closed