Hugging Face's logo

Edentns
/
DataVortexS-10.7B-v0.1

Text Generation
Transformers
Safetensors
Korean
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
JeongwonChoi commited on
Commit
8d61465
•
1 Parent(s): 9ae229f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -10
README.md CHANGED
@@ -53,20 +53,24 @@ text = """\
53
 
54
  ## **Model Benchmark**
55
 
 
 
 
 
 
 
 
 
 
 
 
56
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
57
 
58
  On Benchmarking ...
59
 
60
- | Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
61
- | ---------------------------- | ------- | ------ | ------------ | ------- | ------------- | --------------- |
62
- | DataVortexM-7B-Instruct-v0.1 | 39.81 | 34.13 | 42.35 | 38.73 | 45.46 | 38.37 |
63
- | **DataVortexS-10.7B-v0.1** | **0** | **0** | **0** | **0** | **0** | **0** |
64
- | DataVortexS-10.7B-v0.2 | 43.6 | 38.74 | 50.74 | 38.98 | 44.7 | 44.86 |
65
- | DataVortexS-10.7B-v0.3 | 0 | 0 | 0 | 0 | 0 | 0 |
66
- | DataVortexS-10.7B-v0.4 | 0 | 0 | 0 | 0 | 0 | 0 |
67
- | DataVortexS-10.7B-v1.0 | 0 | 0 | 0 | 0 | 0 | 0 |
68
- | DataVortexTL-1.1B-v0.1 | 0 | 0 | 0 | 0 | 0 | 0 |
69
- | DataVortexS-10.7B-dpo-v0.1 | 0 | 0 | 0 | 0 | 0 | 0 |
70
 
71
  ## **Implementation Code**
72
 
 
53
 
54
  ## **Model Benchmark**
55
 
56
+ ### [Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)
57
+
58
+ On Benchmarking ...
59
+
60
+ | Task | 0-shot | 5-shot | 10-shot | 50-shot |
61
+ | :--------------- | -----: | -----: | ------: | ------: |
62
+ | kobest_boolq | 0.0 | 0.0 | 0.0 | 0.0 |
63
+ | kobest_copa | 0.0 | 0.0 | 0.0 | 0.0 |
64
+ | kobest_hellaswag | 0.0 | 0.0 | 0.0 | 0.0 |
65
+ | kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
66
+
67
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
68
 
69
  On Benchmarking ...
70
 
71
+ | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
72
+ | ------: | -----: | -----------: | ------: | ------------: | --------------: |
73
+ | 0 | 0 | 0 | 0 | 0 | 0 |
 
 
 
 
 
 
 
74
 
75
  ## **Implementation Code**
76