File size: 756 Bytes
d7e574c 76af73d 34d8ba6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
---
language:
- en
tags:
- retrained
- SpanBERT
---
SpanBERT
This is the SpanBERT model from:
Mike Zhang, Kristian Nørgaard Jensen, Sif Dam Sonniks, and Barbara Plank. __SkillSpan: Hard and Soft Skill Extraction from Job Postings__. To appear at the 2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL). 2022.
This model is pre-trained from scratch on the BookCorpus and WikiData. To pre-train from scratch we use the code from Splinter: https://github.com/oriram/splinter.
On our job posting dataset, we found that our `spanbert-base-cased` model works better than the original.
More information can be found in the paper (which should be released when the NAACL proceedings are online). |