Commit
•
ada6f54
1
Parent(s):
bc7da48
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,17 +12,10 @@ FNC-1 (Pomerleau and Rao, 2017), Perspectrum (Chen et al., 2019), ARC (Habernal
|
|
| 12 |
Acheives this score on distilled data. Hand-checked data to come, but similar models with similar scores achieved a 0.57.
|
| 13 |
|
| 14 |
```{
|
| 15 |
-
|
| 16 |
"eval_samples": 6482,
|
| 17 |
-
|
| 18 |
"test_f1": 0.43183643890513856,
|
| 19 |
-
|
| 20 |
"test_loss": 2.9971516132354736,
|
| 21 |
-
|
| 22 |
"test_runtime": 46.1838,
|
| 23 |
-
|
| 24 |
"test_samples_per_second": 140.352,
|
| 25 |
-
|
| 26 |
"test_steps_per_second": 8.791
|
| 27 |
-
|
| 28 |
}```
|
|
|
|
| 12 |
Acheives this score on distilled data. Hand-checked data to come, but similar models with similar scores achieved a 0.57.
|
| 13 |
|
| 14 |
```{
|
|
|
|
| 15 |
"eval_samples": 6482,
|
|
|
|
| 16 |
"test_f1": 0.43183643890513856,
|
|
|
|
| 17 |
"test_loss": 2.9971516132354736,
|
|
|
|
| 18 |
"test_runtime": 46.1838,
|
|
|
|
| 19 |
"test_samples_per_second": 140.352,
|
|
|
|
| 20 |
"test_steps_per_second": 8.791
|
|
|
|
| 21 |
}```
|