alex2awesome
commited on
Commit
•
31bf1e6
1
Parent(s):
4451d2a
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
---
|
6 |
+
|
7 |
+
|
8 |
+
Stance detection model distilled from a news dataset label by a larger model. The larger model was trained on a combination of stance datasets in the literature:
|
9 |
+
|
10 |
+
FNC-1 (Pomerleau and Rao, 2017), Perspectrum (Chen et al., 2019), ARC (Habernal et al., 2017), Emergent (Ferreira and Vlachos, 2016) NewsClaims (Reddy et al., 2021)7.
|
11 |
+
|
12 |
+
Acheives this score on distilled data. Hand-checked data to come, but similar models with similar scores achieved a 0.57.
|
13 |
+
|
14 |
+
{
|
15 |
+
"eval_samples": 6482,
|
16 |
+
"test_f1": 0.43183643890513856,
|
17 |
+
"test_loss": 2.9971516132354736,
|
18 |
+
"test_runtime": 46.1838,
|
19 |
+
"test_samples_per_second": 140.352,
|
20 |
+
"test_steps_per_second": 8.791
|
21 |
+
}
|