Commit
•
6a6e179
1
Parent(s):
e1a6aad
Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,15 @@ tags:
|
|
| 6 |
widget:
|
| 7 |
- text: "Stocks rallied and the British pound <mask>."
|
| 8 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
|
|
|
|
| 10 |
FLANG-ELECTRA is a pre-trained language model which uses financial keywords and phrases for preferential masking of domain specific terms. It is built by further training the ELECTRA language model in the finance domain with improved performance over previous models due to the use of domain knowledge and vocabulary.
|
| 11 |
|
| 12 |
Contact information
|
|
|
|
| 6 |
widget:
|
| 7 |
- text: "Stocks rallied and the British pound <mask>."
|
| 8 |
---
|
| 9 |
+
##FLANG
|
| 10 |
+
FLANG is a set of large language models for Financial LANGuage tasks. These models use domain specific pre-training with preferential masking to build more robust representations for the domain. The models in the set are:\
|
| 11 |
+
[FLANG-BERT](https://huggingface.co/SALT-NLP/FLANG-BERT)\
|
| 12 |
+
[FLANG-SpanBERT](https://huggingface.co/SALT-NLP/FLANG-SpanBERT)\
|
| 13 |
+
[FLANG-DistilBERT](https://huggingface.co/SALT-NLP/FLANG-DistilBERT)\
|
| 14 |
+
[FLANG-Roberta](https://huggingface.co/SALT-NLP/FLANG-Roberta)\
|
| 15 |
+
[Flang-ELECTRA](https://huggingface.co/SALT-NLP/FLANG-ELECTRA)
|
| 16 |
|
| 17 |
+
##FLANG-ELECTRA
|
| 18 |
FLANG-ELECTRA is a pre-trained language model which uses financial keywords and phrases for preferential masking of domain specific terms. It is built by further training the ELECTRA language model in the finance domain with improved performance over previous models due to the use of domain knowledge and vocabulary.
|
| 19 |
|
| 20 |
Contact information
|