imone zhangy03 commited on
Commit
7edf163
1 Parent(s): f6185c3

Update README.md (#2)

Browse files

- Update README.md (c2ad3033ffb1a6cff5728670f0dbc0976d239acf)


Co-authored-by: zhangyan <[email protected]>

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -2,7 +2,7 @@
2
 
3
  ## Model Description
4
 
5
- PanGu-α is proposed by a joint technical team headed by PCNL. It is the first large-scale Chinese pre-trained language model with 200 billion parameters trained on 2048 Ascend processors using an automatic hybrid parallel training strategy. The whole training process is done on the “Peng Cheng Cloud Brain II” computing platform with the domestic deep learning framework called MindSpore. The PengCheng·PanGu-α pre-training model can support rich applications, has strong few-shot learning capabilities, and has outstanding performance in text generation tasks such as knowledge question and answer, knowledge retrieval, knowledge reasoning, and reading comprehension.
6
 
7
  This repository contains PyTorch implementation of PanGu model, with
8
  2.6 billion parameters pretrained weights (FP32 precision), converted from original MindSpore checkpoint.
 
2
 
3
  ## Model Description
4
 
5
+ PanGu-α is proposed by a joint technical team headed by PCNL. It was first released in [this repository](https://git.openi.org.cn/PCL-Platform.Intelligence/PanGu-Alpha) It is the first large-scale Chinese pre-trained language model with 200 billion parameters trained on 2048 Ascend processors using an automatic hybrid parallel training strategy. The whole training process is done on the “Peng Cheng Cloud Brain II” computing platform with the domestic deep learning framework called MindSpore. The PengCheng·PanGu-α pre-training model can support rich applications, has strong few-shot learning capabilities, and has outstanding performance in text generation tasks such as knowledge question and answer, knowledge retrieval, knowledge reasoning, and reading comprehension.
6
 
7
  This repository contains PyTorch implementation of PanGu model, with
8
  2.6 billion parameters pretrained weights (FP32 precision), converted from original MindSpore checkpoint.