File size: 1,151 Bytes
3142e2e f3f3674 adf3c87 f3f3674 adf3c87 f3f3674 3142e2e adf3c87 f3f3674 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 |
---
language:
- zh
tags:
- SongNet
- pytorch
- zh
- Text2Text-Generation
license: apache-2.0
widget:
- text: 丹枫江冷人初去
library_name: transformers
pipeline_tag: fill-mask
---
# SongNet pretrain (songnet-base-chinese) Model
SongNet中文预训练模型
SongNet的网络结构:
![arch](songnet-network.png)
## Usage
本项目开源在文本生成项目:[textgen](https://github.com/shibing624/textgen),可支持SongNet模型。
模型文件组成:
```
songnet-base-chinese
├── pytorch_model.bin
└── vocab.txt
```
### 相关内容
- [SongNet paper](https://aclanthology.org/2020.acl-main.68/)
- [textgen](https://github.com/shibing624/textgen)
如果需要训练SongNet模型,请参考[https://github.com/shibing624/textgen/blob/main/examples/language_generation/training_zh_songnet_demo.py](https://github.com/shibing624/textgen/blob/main/examples/language_generation/training_zh_songnet_demo.py)
## Citation
```latex
@software{textgen,
author = {Xu Ming},
title = {textgen: Implementation of Text Generation models},
year = {2022},
url = {https://github.com/shibing624/textgen},
}
``` |