Update README.md

README.md

@@ -4,14 +4,48 @@ language: "en"
 tags:
 - Financial Language Modelling
 widget:
-- text: "Stocks rallied and the British pound [MASK]."
+- text: "Stocks rallied and the British pound <mask>."
 ---
+## FLANG
+FLANG is a set of large language models for Financial LANGuage tasks. These models use domain specific pre-training with preferential masking to build more robust representations for the domain. The models in the set are:\
+[FLANG-BERT](https://huggingface.co/SALT-NLP/FLANG-BERT)\
+[FLANG-SpanBERT](https://huggingface.co/SALT-NLP/FLANG-SpanBERT)\
+[FLANG-DistilBERT](https://huggingface.co/SALT-NLP/FLANG-DistilBERT)\
+[FLANG-Roberta](https://huggingface.co/SALT-NLP/FLANG-Roberta)\
+[Flang-ELECTRA](https://huggingface.co/SALT-NLP/FLANG-ELECTRA)
 
+## FLANG-DistilBERT
 FLANG-DistilBERT is a pre-trained language model which uses financial keywords and phrases for preferential masking of domain specific terms. It is built by further training the DistilBERT language model in the finance domain with improved performance over previous models due to the use of domain knowledge and vocabulary.
+## Citation
+Please cite the model with the following citation:
+```bibtex
+@INPROCEEDINGS{shah-etal-2022-flang,
+    author = {Shah, Raj Sanjay  and
+      Chawla, Kunal and
+      Eidnani, Dheeraj and
+      Shah, Agam and
+      Du, Wendi and
+      Chava, Sudheer and
+      Raman, Natraj and
+      Smiley, Charese and
+      Chen, Jiaao and
+      Yang, Diyi },
+    title = {When FLUE Meets FLANG: Benchmarks and Large Pretrained Language Model for Financial Domain},
+    booktitle = {Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP)},
+    year = {2022},
+    publisher = {Association for Computational Linguistics}
+}
+```
+
+## Contact information
+Please contact Raj Sanjay Shah (rajsanjayshah[at]gatech[dot]edu) or Sudheer Chava (schava6[at]gatech[dot]edu) or Diyi Yang (diyiy[at]stanford[dot]edu) about any FLANG-ELECTRA related issues and questions.
+
+
+---
+license: afl-3.0
+---
 
-Contact information
 
-Please contact Raj Sanjay Shah (rajsanjayshah[at]gatech[dot]edu) or Sudheer Chava (schava6[at]gatech[dot]edu) or Diyi Yang (diyiy[at]stanford[dot]edu) about any FLANG-BERT related issues and questions.
 
 
 ---