Commit
•
1733fd5
1
Parent(s):
d54f998
Update README.md
Browse files
README.md
CHANGED
|
@@ -51,4 +51,18 @@ parameters:
|
|
| 51 |
int8_mask: true
|
| 52 |
dtype: bfloat16
|
| 53 |
|
| 54 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
int8_mask: true
|
| 52 |
dtype: bfloat16
|
| 53 |
|
| 54 |
+
```
|
| 55 |
+
|
| 56 |
+
Open LLM Leaderboard Evaluation Results
|
| 57 |
+
|
| 58 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/results/blob/main/Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base/results_2024-10-03T03-40-13.800772.json)
|
| 59 |
+
|
| 60 |
+
| Metric |Value|
|
| 61 |
+
|-------------------|----:|
|
| 62 |
+
|Average Score |43.07|
|
| 63 |
+
|IFEval (0-Shot) |80.96|
|
| 64 |
+
|BBH (3-Shot) |51.10|
|
| 65 |
+
|MATH Lvl 5 (4-Shot)|15.56|
|
| 66 |
+
|GPQA (0-shot) |30.96|
|
| 67 |
+
|MuSR (0-shot) |41.01|
|
| 68 |
+
|MMLU-PRO (5-shot) |38.80|
|