|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
--- |
|
|
|
|
|
Stance detection model distilled from a news dataset label by a larger model. The larger model was trained on a combination of stance datasets in the literature: |
|
|
|
FNC-1 (Pomerleau and Rao, 2017), Perspectrum (Chen et al., 2019), ARC (Habernal et al., 2017), Emergent (Ferreira and Vlachos, 2016) NewsClaims (Reddy et al., 2021)7. |
|
|
|
Acheives this score on distilled data. Hand-checked data to come, but similar models with similar scores achieved a 0.57. |
|
|
|
```{ |
|
|
|
"eval_samples": 6482, |
|
|
|
"test_f1": 0.43183643890513856, |
|
|
|
"test_loss": 2.9971516132354736, |
|
|
|
"test_runtime": 46.1838, |
|
|
|
"test_samples_per_second": 140.352, |
|
|
|
"test_steps_per_second": 8.791 |
|
|
|
}``` |
