Update README.md
Browse files
README.md
CHANGED
|
@@ -28,6 +28,17 @@ In the second phase, it was fine-tuned with LLaVA-v1.5-Instruct-620K-JA.
|
|
| 28 |
|
| 29 |
resources for more information: https://github.com/tosiyuki/LLaVA-JP/tree/main
|
| 30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
## How to use the model
|
| 32 |
**1. Download dependencies**
|
| 33 |
```
|
|
|
|
| 28 |
|
| 29 |
resources for more information: https://github.com/tosiyuki/LLaVA-JP/tree/main
|
| 30 |
|
| 31 |
+
**Comparing VLMs:**
|
| 32 |
+
|Model|JA-VG-VQA-500<br>(ROUGE-L)|JA-VLM-Bench-In-the-Wild<br>(ROUGE-L)|Heron-Bench(Detail)|Heron-Bench(Conv)|Heron-Bench(Complex)|Heron-Bench(Average)
|
| 33 |
+
|-|-|-|-|-|-|-|
|
| 34 |
+
|[Japanese Stable VLM](https://huggingface.co/stabilityai/japanese-stable-vlm)|-|40.50|25.15|51.23|37.84|38.07|
|
| 35 |
+
|[EvoVLM-JP-v1-7B](https://huggingface.co/SakanaAI/EvoVLM-JP-v1-7B)|**19.70**|**51.25**|50.31|44.42|40.47|45.07|
|
| 36 |
+
|[Heron BLIP Japanese StableLM Base 7B llava-620k](https://huggingface.co/turing-motors/heron-chat-blip-ja-stablelm-base-7b-v1-llava-620k)|14.51|33.26|49.09|41.51|45.72|45.44|
|
| 37 |
+
|[Heron GIT Japanese StableLM Base 7B](https://huggingface.co/turing-motors/heron-chat-git-ja-stablelm-base-7b-v1)|15.18|37.82|42.77|**54.20**|43.53|46.83|
|
| 38 |
+
|[llava-jp-1.3b-v1.0-620k](https://huggingface.co/toshi456/llava-jp-1.3b-v1.0-620k)|12.69|44.58|**51.21**|41.05|45.95|44.84|
|
| 39 |
+
|[llava-jp-1.3b-v1.1](https://huggingface.co/toshi456/llava-jp-1.3b-v1.1)|13.33|44.40|50.00|51.83|**48.98**|**50.39**|
|
| 40 |
+
|[llava-jp-karasu-1.1b-v1.0-620k](https://huggingface.co/toshi456/llava-jp-karasu-1.1b-v1.0-620k)|13.23|44.59|42.16|43.79|40.35|42.16|
|
| 41 |
+
|
| 42 |
## How to use the model
|
| 43 |
**1. Download dependencies**
|
| 44 |
```
|