Commit
•
7f7c3ec
1
Parent(s):
e52e1b6
Update README.md
Browse files
README.md
CHANGED
|
@@ -114,6 +114,18 @@ The model was originally trained about 2 month after Mistral (v0.1) was released
|
|
| 114 |
As of 04 June 2024, Zion_Alpha got the **Highest SNLI score in the world** among open source models in Hebrew, surpassing most of the models by a huge margin. (**84.05** score)
|
| 115 |
<img src="https://i.imgur.com/7HokS5w.png" alt="Zion_Alpha SNLI Score" style="width: 80%; min-width: 700px; display: block; margin: auto;">
|
| 116 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 117 |
### Support
|
| 118 |
<img src="https://i.imgur.com/0lHHN95.png" alt="GPUs too expensive" style="width: 10%; min-width: 100px; display: block; margin: left;">
|
| 119 |
|
|
|
|
| 114 |
As of 04 June 2024, Zion_Alpha got the **Highest SNLI score in the world** among open source models in Hebrew, surpassing most of the models by a huge margin. (**84.05** score)
|
| 115 |
<img src="https://i.imgur.com/7HokS5w.png" alt="Zion_Alpha SNLI Score" style="width: 80%; min-width: 700px; display: block; margin: auto;">
|
| 116 |
|
| 117 |
+
|
| 118 |
+
### Benchmarks
|
| 119 |
+
|
| 120 |
+
| Metric |Value|
|
| 121 |
+
|-------------------|----:|
|
| 122 |
+
|Avg. |19.11|
|
| 123 |
+
|IFEval (0-Shot) |33.24|
|
| 124 |
+
|BBH (3-Shot) |29.16|
|
| 125 |
+
|MATH Lvl 5 (4-Shot)| 4.76|
|
| 126 |
+
|GPQA (0-shot) | 5.37|
|
| 127 |
+
|MuSR (0-shot) |18.45|
|
| 128 |
+
|MMLU-PRO (5-shot) |23.68|
|
| 129 |
### Support
|
| 130 |
<img src="https://i.imgur.com/0lHHN95.png" alt="GPUs too expensive" style="width: 10%; min-width: 100px; display: block; margin: left;">
|
| 131 |
|