neuralmagic
/

Llama-2-7b-dolphin-open_platypus-pruned_50

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Update README.md

#2

by shubhrapandit - opened Mar 19

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -50,8 +50,8 @@ Model evaluation metrics and results.
 | Benchmark                                      | Metric        | Llama-2-7b-instruct  | Llama-2-7b-pruned50-retrained-instruct |
 |------------------------------------------------|---------------|-------------|-------------------------------|
-| [MMLU](https://arxiv.org/abs/2009.03300)       | 5-shot, top-1 | 48.60%  | 45.10% |
-| [HellaSwag](https://arxiv.org/abs/1905.07830)  | 0-shot        | 79.45%  | 78.86% |
 | [WinoGrande](https://arxiv.org/abs/1907.10641) | 5-shot        | 75.69%  | 72.61% |
 | [ARC-c](https://arxiv.org/abs/1911.01547)      | 25-shot       | 53.92%  | 50.77% |
 | [TruthfulQA](https://arxiv.org/abs/2109.07958) | 0-shot        | 43.63%  | 44.40% |

 | Benchmark                                      | Metric        | Llama-2-7b-instruct  | Llama-2-7b-pruned50-retrained-instruct |
 |------------------------------------------------|---------------|-------------|-------------------------------|
+| [MMLU](https://arxiv.org/abs/2009.03300)       | 5-shot        | 48.60%  | 45.10% |
+| [HellaSwag](https://arxiv.org/abs/1905.07830)  | 10-shot       | 79.45%  | 78.86% |
 | [WinoGrande](https://arxiv.org/abs/1907.10641) | 5-shot        | 75.69%  | 72.61% |
 | [ARC-c](https://arxiv.org/abs/1911.01547)      | 25-shot       | 53.92%  | 50.77% |
 | [TruthfulQA](https://arxiv.org/abs/2109.07958) | 0-shot        | 43.63%  | 44.40% |