p208p2002/bloomz-Alpaca-560M-GGUF

Quantized GGUF model files for bloomz-Alpaca-560M from p208p2002

Name	Quant method	Size
bloomz-alpaca-560m.q2_k.gguf	q2_k	430.81 MB
bloomz-alpaca-560m.q3_k_m.gguf	q3_k_m	492.33 MB
bloomz-alpaca-560m.q4_k_m.gguf	q4_k_m	561.16 MB
bloomz-alpaca-560m.q5_k_m.gguf	q5_k_m	625.29 MB
bloomz-alpaca-560m.q6_k.gguf	q6_k	682.78 MB
bloomz-alpaca-560m.q8_0.gguf	q8_0	880.26 MB

Original Model Card:

Fine-Tune BLOOMZ Model on Alpaca 52K.