alex2awesome commited on
Commit
31bf1e6
1 Parent(s): 4451d2a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ ---
6
+
7
+
8
+ Stance detection model distilled from a news dataset label by a larger model. The larger model was trained on a combination of stance datasets in the literature:
9
+
10
+ FNC-1 (Pomerleau and Rao, 2017), Perspectrum (Chen et al., 2019), ARC (Habernal et al., 2017), Emergent (Ferreira and Vlachos, 2016) NewsClaims (Reddy et al., 2021)7.
11
+
12
+ Acheives this score on distilled data. Hand-checked data to come, but similar models with similar scores achieved a 0.57.
13
+
14
+ {
15
+ "eval_samples": 6482,
16
+ "test_f1": 0.43183643890513856,
17
+ "test_loss": 2.9971516132354736,
18
+ "test_runtime": 46.1838,
19
+ "test_samples_per_second": 140.352,
20
+ "test_steps_per_second": 8.791
21
+ }