README.md

---
language:
- zh
tags:
- SongNet
- pytorch
- zh
- Text2Text-Generation
license: apache-2.0
widget:
- text: 丹枫江冷人初去
library_name: transformers
pipeline_tag: fill-mask
---

# SongNet pretrain (songnet-base-chinese) Model
SongNet中文预训练模型

SongNet的网络结构：

![arch](songnet-network.png)

## Usage

本项目开源在文本生成项目：[textgen](https://github.com/shibing624/textgen)，可支持SongNet模型。

模型文件组成：
```
songnet-base-chinese
    ├── pytorch_model.bin
    └── vocab.txt
```


### 相关内容
  - [SongNet paper](https://aclanthology.org/2020.acl-main.68/)
  - [textgen](https://github.com/shibing624/textgen)
  

如果需要训练SongNet模型，请参考[https://github.com/shibing624/textgen/blob/main/examples/language_generation/training_zh_songnet_demo.py](https://github.com/shibing624/textgen/blob/main/examples/language_generation/training_zh_songnet_demo.py)


## Citation

```latex
@software{textgen,
  author = {Xu Ming},
  title = {textgen: Implementation of Text Generation models},
  year = {2022},
  url = {https://github.com/shibing624/textgen},
}
```