rombodawg commited on
Commit
b60b77f
1 Parent(s): d62381a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ base_model:
4
+ - Qwen/Qwen2.5-0.5B-Instruct
5
+ license: apache-2.0
6
+ ---
7
+ # Rombos-LLM-V2.5-Qwen-0.5b
8
+
9
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642cc1c253e76b4c2286c58e/0J3zpmPZ29y46VDa1cd1l.jpeg)
10
+
11
+ Rombos-LLM-V2.5-Qwen-0.5b is a continues finetuned version of Qwen2.5-0.5B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the *Ties* merge method
12
+
13
+ This version of the model shows higher performance than the original instruct and base models.
14
+
15
+ Quants:
16
+
17
+ GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-0.5b-GGUF
18
+
19
+ Benchmarks: (Coming soon)