JMLR-13B For MedQA
| Model | Parameter | Open Access | MedQA | Amboss | MMLU | MedMCQA | Average |
|---|---|---|---|---|---|---|---|
| GPT-4 | ? | No | 74.7 | 82.1 | 88.4 | 69.5 | 78.6 |
| ChatGPT | ? | No | 50.2 | 49.1 | 69.4 | 51.0 | 54.9 |
| Meditron | 70B | Yes | 60.7 | 76.4 | 73.6 | 65.1 | 68.9 |
| RAG | 13B | Yes | 59.9 | 76.9 | 69.9 | 64.2 | 67.7 |
| JLMR | 13B | Yes | 62.5 | 81.2 | 72.8 | 65.5 | 70.5 |