Edentns
/

DataVortexS-10.7B-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JeongwonChoi commited on Jan 17

Commit

ff13f5a

•

1 Parent(s): a1c9cde

Update README.md

Files changed (1) hide show

README.md +7 -8

README.md CHANGED Viewed

@@ -55,14 +55,13 @@ text = """\
 ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
-On Benchmarking ...
-| Task             | 0-shot | 5-shot | 10-shot | 50-shot |
-| :--------------- | -----: | -----: | ------: | ------: |
-| kobest_boolq     |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_copa      |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_hellaswag |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_sentineg  |    0.0 |    0.0 |     0.0 |     0.0 |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**

 ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
+| Task             |         0-shot |       5-shot |       10-shot |      50-shot |
+| :--------------- | -------------: | -----------: | ------------: | -----------: |
+| kobest_boolq     |       0.334282 |     0.642861 |      0.691496 |     0.638754 |
+| kobest_copa      |       0.584962 |     0.564325 |      0.570654 |     0.581035 |
+| kobest_hellaswag |       0.340022 |     0.339401 |      0.341917 |     0.337713 |
+| kobest_sentineg  |       0.328257 |     0.414905 |      0.464711 |     0.888914 |
+| **Average**      | **0.39688075** | **0.490373** | **0.5171945** | **0.611604** |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**