File size: 922 Bytes
26d4600 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|openbookqa | 1|none | 0|acc |0.2060|± |0.0181|
| | |none | 0|acc_norm|0.3420|± |0.0212|
|arc_challenge| 1|none | 0|acc |0.3345|± |0.0138|
| | |none | 0|acc_norm|0.3498|± |0.0139|
|arc_easy | 1|none | 0|acc |0.6343|± |0.0099|
| | |none | 0|acc_norm|0.5833|± |0.0101|
|winogrande | 1|none | 0|acc |0.5691|± |0.0139|
|hellaswag | 1|none | 0|acc |0.4445|± |0.0050|
| | |none | 0|acc_norm|0.5966|± |0.0049|
|piqa | 1|none | 0|acc |0.6752|± |0.0109|
| | |none | 0|acc_norm|0.6768|± |0.0109|
|boolq | 2|none | 0|acc |0.6709|± |0.0082|
|