File size: 1,151 Bytes
3142e2e
f3f3674
adf3c87
 
 
 
 
 
f3f3674
adf3c87
f3f3674
 
 
3142e2e
adf3c87
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f3f3674
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
---
language:
- zh
tags:
- SongNet
- pytorch
- zh
- Text2Text-Generation
license: apache-2.0
widget:
- text: 丹枫江冷人初去
library_name: transformers
pipeline_tag: fill-mask
---

# SongNet pretrain (songnet-base-chinese) Model
SongNet中文预训练模型

SongNet的网络结构:

![arch](songnet-network.png)

## Usage

本项目开源在文本生成项目:[textgen](https://github.com/shibing624/textgen),可支持SongNet模型。

模型文件组成:
```
songnet-base-chinese
    ├── pytorch_model.bin
    └── vocab.txt
```


### 相关内容
  - [SongNet paper](https://aclanthology.org/2020.acl-main.68/)
  - [textgen](https://github.com/shibing624/textgen)
  

如果需要训练SongNet模型,请参考[https://github.com/shibing624/textgen/blob/main/examples/language_generation/training_zh_songnet_demo.py](https://github.com/shibing624/textgen/blob/main/examples/language_generation/training_zh_songnet_demo.py)


## Citation

```latex
@software{textgen,
  author = {Xu Ming},
  title = {textgen: Implementation of Text Generation models},
  year = {2022},
  url = {https://github.com/shibing624/textgen},
}
```