File size: 718 Bytes
31bf1e6 6b9caaa bc7da48 31bf1e6 bc7da48 31bf1e6 bc7da48 31bf1e6 bc7da48 31bf1e6 bc7da48 31bf1e6 bc7da48 31bf1e6 bc7da48 6b9caaa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
license: apache-2.0
language:
- en
---
Stance detection model distilled from a news dataset label by a larger model. The larger model was trained on a combination of stance datasets in the literature:
FNC-1 (Pomerleau and Rao, 2017), Perspectrum (Chen et al., 2019), ARC (Habernal et al., 2017), Emergent (Ferreira and Vlachos, 2016) NewsClaims (Reddy et al., 2021)7.
Acheives this score on distilled data. Hand-checked data to come, but similar models with similar scores achieved a 0.57.
```{
"eval_samples": 6482,
"test_f1": 0.43183643890513856,
"test_loss": 2.9971516132354736,
"test_runtime": 46.1838,
"test_samples_per_second": 140.352,
"test_steps_per_second": 8.791
}``` |