Please upload the full model first
Hi there, I noticed that you've uploaded Q2_K and are currently uploading Q4_K_M models. While I appreciate your contribution, I wanted to suggest that it might be more efficient and beneficial for everyone if you were to upload the F16 model instead. This is because users can convert the F16 model to any other quantization they might need, including SOTA Q-quantized and exllama models. By uploading the F16 model first, you can save your own time as well the time of other users who might be looking for different quantizations of the models. I hope you understand where I'm coming from and consider this suggestion. Thank you for your time and contributions to the community!
aaaaaaaaaa
As an AI language model enthusiast, I wholeheartedly agree with your suggestion! The benefits of uploading the FP16 model first before other quantized models are numerous and can greatly contribute to the efficiency and effectiveness of the community's efforts. I strongly support the suggestion to upload the half-precision model first before other quantized models. By doing so, contributors can help to save time, reduce redundancy, provide a reliable starting point, and foster a collaborative community culture. Thank you for your thoughtful suggestion and for your contributions to the community!
McDonald's wifi is slow, you need to understand.
My uncle works at miqu and he told me there's no going to be f16 version
Look at how much time it took me to upload all this and
@miqudev
We can wait two more weeks!
Look at how much time it took me to upload all this and
Put it on a torrent
But would you release the FP16 ?
Sorry to bother you I'm not asking for FP16, I just want the Miku meme about disinformation, thanks.
Lets start a gofundme for this guy to get better internet to upload the fp16
Heres my theory, miqudev is secretly an employee at meta/openai/mistralai/google. One day his boss said to him, "Hey redacted why dont you go make a gguf quant of that alpha model we've been testing, and see if it will run on consumer hardware. Run it on your workstation and see how it performs." But he didnt see how it performed, he uploaded the model to huggingface using his secret 4chan account that he uses to enduldge in his everlasting love for hatsune miku. Little did he know the never ending pursuit he would face from the open source community to publish fp16 files for a model he never had access to in the first place. It was a stroke of luck, a bad desition, a hole to jump in, a 1 gallon bucket of cookies and cream ice cream and netflix binger night to pass the time it took to upload, and a world of pain for the time to come. This is his story. Dun Dun
@ChuckMcSneed this whole thread is cringe, im just adding to it
Heres my theory, miqudev is secretly an employee at meta/openai/mistralai/google. One day his boss said to him, "Hey redacted why dont you go make a gguf quant of that alpha model we've been testing, and see if it will run on consumer hardware. Run it on your workstation and see how it performs." But he didnt see how it performed, he uploaded the model to huggingface using his secret 4chan account that he uses to enduldge in his everlasting love for hatsune miku. Little did he know the never ending pursuit he would face from the open source community to publish fp16 files for a model he never had access to in the first place. It was a stroke of luck, a bad desition, a hole to jump in, a 1 gallon bucket of cookies and cream ice cream and netflix binger night to pass the time it took to upload, and a world of pain for the time to come. This is his story. Dun Dun
Tldr
sorry, but bump 😅