alex2awesome/stance-detection-classification-model

Stance detection model distilled from a news dataset label by a larger model. The larger model was trained on a combination of stance datasets in the literature:

FNC-1 (Pomerleau and Rao, 2017), Perspectrum (Chen et al., 2019), ARC (Habernal et al., 2017), Emergent (Ferreira and Vlachos, 2016) NewsClaims (Reddy et al., 2021)7.

Acheives this score on distilled data. Hand-checked data to come, but similar models with similar scores achieved a 0.57.

    "eval_samples": 6482,
    "test_f1": 0.43183643890513856,
    "test_loss": 2.9971516132354736,
    "test_runtime": 46.1838,
    "test_samples_per_second": 140.352,
    "test_steps_per_second": 8.791
}```