Taishi-N324
commited on
Commit
•
48a37a7
1
Parent(s):
5b1d1b1
Upload README.md
Browse files
README.md
CHANGED
@@ -53,7 +53,7 @@ This repository provides large language models developed by [TokyoTech-LLM](http
|
|
53 |
### MT-Bench JA
|
54 |
|
55 |
* NOTE that the models with the `v0.1` suffix are newer versions compared to their original counterparts with the `hf`.
|
56 |
-
* We will
|
57 |
|
58 |
|Model|Average|Writing|Roleplay|Reasoning|Math|Coding|Extraction|STEM|Humanities|
|
59 |
|---|---|---|---|---|---|---|---|---|---|
|
@@ -68,7 +68,7 @@ This repository provides large language models developed by [TokyoTech-LLM](http
|
|
68 |
|
69 |
### MT-Bench JA
|
70 |
|
71 |
-
We used [Japanese MT-Bench](https://wandb.ai/wandb-japan/llm-leaderboard/artifacts/dataset/mtbench_ja_question).
|
72 |
We utilized the following artifacts:
|
73 |
|
74 |
- Implemantation: FastChat [Zheng+, 2023] (commit #e86e70d0)
|
@@ -166,4 +166,3 @@ Here are the team members:
|
|
166 |
- [Taishi Nakamura](https://twitter.com/Setuna7777_2)
|
167 |
- [Takumi Okamoto](https://www.linkedin.com/in/takumi-okamoto)
|
168 |
- [Ishida Shigeki](https://www.wantedly.com/id/reborn27)
|
169 |
-
|
|
|
53 |
### MT-Bench JA
|
54 |
|
55 |
* NOTE that the models with the `v0.1` suffix are newer versions compared to their original counterparts with the `hf`.
|
56 |
+
* We will add the scores of `Swallow-70b-instruct-hf` and existing models soon.
|
57 |
|
58 |
|Model|Average|Writing|Roleplay|Reasoning|Math|Coding|Extraction|STEM|Humanities|
|
59 |
|---|---|---|---|---|---|---|---|---|---|
|
|
|
68 |
|
69 |
### MT-Bench JA
|
70 |
|
71 |
+
We used [Japanese MT-Bench](https://wandb.ai/wandb-japan/llm-leaderboard/artifacts/dataset/mtbench_ja_question) to assess the instruction-following capabilities of models.
|
72 |
We utilized the following artifacts:
|
73 |
|
74 |
- Implemantation: FastChat [Zheng+, 2023] (commit #e86e70d0)
|
|
|
166 |
- [Taishi Nakamura](https://twitter.com/Setuna7777_2)
|
167 |
- [Takumi Okamoto](https://www.linkedin.com/in/takumi-okamoto)
|
168 |
- [Ishida Shigeki](https://www.wantedly.com/id/reborn27)
|
|