SicariusSicariiStuff
commited on
Commit
•
dfef7b7
1
Parent(s):
31eea6a
Update README.md
Browse files
README.md
CHANGED
@@ -18,6 +18,20 @@ license: apache-2.0
|
|
18 |
|
19 |
Zion_Alpha is the first **REAL** Hebrew model in the world. It wasn't finetuned for any tasks yet, but it actually understands and comprehends Hebrew. It can even do some decent translation. I've tested GPT4 vs Zion_Alpha, and out of the box, Zion_Alpha did a better job translating. I did the finetune using SOTA techniques and using my insights from years of underwater basket weaving. If you wanna offer me a job, just add me on Facebook.
|
20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
# Model architecture
|
22 |
Based on Mistral 7B. I didn't even bother to alter the tokenizer.
|
23 |
|
|
|
18 |
|
19 |
Zion_Alpha is the first **REAL** Hebrew model in the world. It wasn't finetuned for any tasks yet, but it actually understands and comprehends Hebrew. It can even do some decent translation. I've tested GPT4 vs Zion_Alpha, and out of the box, Zion_Alpha did a better job translating. I did the finetune using SOTA techniques and using my insights from years of underwater basket weaving. If you wanna offer me a job, just add me on Facebook.
|
20 |
|
21 |
+
# Future Plans
|
22 |
+
I plan to perform a SLERP merge with one of my other fine-tuned models, which has a bit more knowledge about Israeli topics. Additionally, I might create a larger model using MergeKit, but we'll see how it goes.
|
23 |
+
|
24 |
+
# Looking for Sponsors
|
25 |
+
Since all my work is done on-premises, I am constrained by my current hardware. I would greatly appreciate any support in acquiring an A6000, which would enable me to train significantly larger models much faster.
|
26 |
+
|
27 |
+
# Contact Details
|
28 |
+
I'm not great at self-marketing (tp say the least) and don't have any social media accounts. If you'd like to reach out to me, you can email me at [email protected]. Please note that this email might receive more messages than I can handle, so I apologize in advance if I can't respond to everyone.
|
29 |
+
|
30 |
+
# Versions and QUANTS
|
31 |
+
- Base model: [FP16](https://huggingface.co/SicariusSicariiStuff/Zion_Alpha)
|
32 |
+
- Instruction tuned: [FP16](https://huggingface.co/SicariusSicariiStuff/Zion_Alpha_Instruction_Tuned) | [GGUF](https://huggingface.co/SicariusSicariiStuff/Zion_Alpha_Instruction_Tuned_GGUF)
|
33 |
+
|
34 |
+
|
35 |
# Model architecture
|
36 |
Based on Mistral 7B. I didn't even bother to alter the tokenizer.
|
37 |
|