Upload README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,8 @@ license: "apache-2.0"
|
|
9 |
# Please use 'Bert' related functions to load this model!
|
10 |
|
11 |
## Chinese small pre-trained model MiniRBT
|
12 |
-
|
|
|
13 |
|
14 |
This repository is developed based on:https://github.com/iflytek/ta-minilm-demo
|
15 |
|
|
|
9 |
# Please use 'Bert' related functions to load this model!
|
10 |
|
11 |
## Chinese small pre-trained model MiniRBT
|
12 |
+
|
13 |
+
In order to further promote the research and development of Chinese information processing, we launched a Chinese small pre-training model MiniRBT based on the self-developed knowledge distillation tool TextBrewer, combined with Whole Word Masking technology and Knowledge Distillation technology.
|
14 |
|
15 |
This repository is developed based on:https://github.com/iflytek/ta-minilm-demo
|
16 |
|