SicariusSicariiStuff
commited on
Commit
•
929de91
1
Parent(s):
c308e8c
Update README.md
Browse files
README.md
CHANGED
@@ -18,6 +18,15 @@ license: apache-2.0
|
|
18 |
|
19 |
Zion_Alpha is the first **REAL** Hebrew model in the world. This version WAS fine tuned for tasks. I did the finetune using SOTA techniques and using my insights from years of underwater basket weaving. If you wanna offer me a job, just add me on Facebook.
|
20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
# Model architecture
|
22 |
Based on Mistral 7B. I didn't even bother to alter the tokenizer.
|
23 |
|
|
|
18 |
|
19 |
Zion_Alpha is the first **REAL** Hebrew model in the world. This version WAS fine tuned for tasks. I did the finetune using SOTA techniques and using my insights from years of underwater basket weaving. If you wanna offer me a job, just add me on Facebook.
|
20 |
|
21 |
+
# Future Plans
|
22 |
+
I plan to perform a SLERP merge with one of my other fine-tuned models, which has a bit more knowledge about Israeli topics. Additionally, I might create a larger model using MergeKit, but we'll see how it goes.
|
23 |
+
|
24 |
+
# Looking for Sponsors
|
25 |
+
Since all my work is done on-premises, I am constrained by my current hardware. I would greatly appreciate any support in acquiring an A6000, which would enable me to train significantly larger models much faster.
|
26 |
+
|
27 |
+
# Contact Details
|
28 |
+
I'm not great at self-marketing (tp say the least) and don't have any social media accounts. If you'd like to reach out to me, you can email me at [email protected]. Please note that this email might receive more messages than I can handle, so I apologize in advance if I can't respond to everyone.
|
29 |
+
|
30 |
# Model architecture
|
31 |
Based on Mistral 7B. I didn't even bother to alter the tokenizer.
|
32 |
|