m-polignano-uniba
commited on
Commit
•
8a46cc2
1
Parent(s):
18b3fcb
Update README.md
Browse files
README.md
CHANGED
@@ -245,6 +245,11 @@ For direct use with `unsloth`, you can easily get started with the following ste
|
|
245 |
**Open LLM Leaderboard:**
|
246 |
|
247 |
Evaluated with lm-evaluation-benchmark-harness for the [**Open Italian LLMs Leaderboard**](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard)
|
|
|
|
|
|
|
|
|
|
|
248 |
| Metric | Value |
|
249 |
|-----------------------|---------------------------|
|
250 |
| Avg. | **--** |
|
|
|
245 |
**Open LLM Leaderboard:**
|
246 |
|
247 |
Evaluated with lm-evaluation-benchmark-harness for the [**Open Italian LLMs Leaderboard**](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard)
|
248 |
+
```
|
249 |
+
lm_eval --model hf --model_args pretrained=HUGGINGFACE_MODEL_ID --tasks hellaswag_it,arc_it --device cuda:0 --batch_size auto:2
|
250 |
+
lm_eval --model hf --model_args pretrained=HUGGINGFACE_MODEL_ID --tasks m_mmlu_it --num_fewshot 5 --device cuda:0 --batch_size auto:2
|
251 |
+
```
|
252 |
+
|
253 |
| Metric | Value |
|
254 |
|-----------------------|---------------------------|
|
255 |
| Avg. | **--** |
|