TE-for-Event-Extraction

Model description

This is a TE model as part of the event extraction system in the ACL2021 paper: Zero-shot Event Extraction via Transfer Learning: Challenges and Insights. The pretrained architecture is roberta-large and the fine-tuning data is MNLI.

The label mapping is:

LABEL_0: Contradiction
LABEL_1: Neutral
LABEL_2: Entailment

Demo

To see how the model works, type a sentence and a hypothesis separated by "</s></s>" in the right-hand-side textbox under "Hosted inference API".

Example:

Input:

A car bomb exploded Thursday in a crowded outdoor market in the heart of Jerusalem. </s></s>  This text is about an attack.

Output:

LABEL_2 (Entailment)

Usage

To use the TE model independently, follow the huggingface documentation on AutoModelForSequenceClassification.
To use it as part of the event extraction system, please check out our Github repo.

BibTeX entry and citation info

@inproceedings{lyu-etal-2021-zero,
    title = "Zero-shot Event Extraction via Transfer Learning: {C}hallenges and Insights",
    author = "Lyu, Qing  and
      Zhang, Hongming  and
      Sulem, Elior  and
      Roth, Dan",
    booktitle = "Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)",
    month = aug,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2021.acl-short.42",
    doi = "10.18653/v1/2021.acl-short.42",
    pages = "322--332",
    abstract = "Event extraction has long been a challenging task, addressed mostly with supervised methods that require expensive annotation and are not extensible to new event ontologies. In this work, we explore the possibility of zero-shot event extraction by formulating it as a set of Textual Entailment (TE) and/or Question Answering (QA) queries (e.g. {``}A city was attacked{''} entails {``}There is an attack{''}), exploiting pretrained TE/QA models for direct transfer. On ACE-2005 and ERE, our system achieves acceptable results, yet there is still a large gap from supervised approaches, showing that current QA and TE technologies fail in transferring to a different domain. To investigate the reasons behind the gap, we analyze the remaining key challenges, their respective impact, and possible improvement directions.",
}