full disk on colab
#2
by
Dav22
- opened
why when I Save to q4_k_m GGUF disk on colab is full, and is there another solution or should I use colab pro? thanks
@Dav22 Oh did you do multiple GGUF saves?
this is the code I ran to save the GGUF
model.save_pretrained_gguf("model", tokenizer, quantization_method = "q4_k_m")
model.push_to_hub_gguf("hf/model", tokenizer, quantization_method = "q4_k_m", token = "")