BABYLLM
Collection
The baby-LLM is the future of LLM.
•
1 item
•
Updated
•
1
It's a super tiny llama3 model.
It has 0.247B parameters.
It is pretrained on the fineweb-edu dataset.(10B)
I hope I can make it beter and better.
If you see it, please give me a like. Thanks.
More info will be added later.