File size: 711 Bytes
31bf1e6 6b9caaa 31bf1e6 6b9caaa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
license: apache-2.0
language:
- en
---
Stance detection model distilled from a news dataset label by a larger model. The larger model was trained on a combination of stance datasets in the literature:
FNC-1 (Pomerleau and Rao, 2017), Perspectrum (Chen et al., 2019), ARC (Habernal et al., 2017), Emergent (Ferreira and Vlachos, 2016) NewsClaims (Reddy et al., 2021)7.
Acheives this score on distilled data. Hand-checked data to come, but similar models with similar scores achieved a 0.57.
```{
"eval_samples": 6482,
"test_f1": 0.43183643890513856,
"test_loss": 2.9971516132354736,
"test_runtime": 46.1838,
"test_samples_per_second": 140.352,
"test_steps_per_second": 8.791
}``` |