Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,10 @@ pipeline_tag: text-generation
|
|
| 11 |
|
| 12 |
# Llama3-8b-chinese-chat-32k
|
| 13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
## 训练方式
|
| 15 |
|
| 16 |
* 使用 NTK-aware 方法扩展上下文长度至 **32k**
|
|
|
|
| 11 |
|
| 12 |
# Llama3-8b-chinese-chat-32k
|
| 13 |
|
| 14 |
+
* 📄[Paper](https://arxiv.org/abs/2312.11193)
|
| 15 |
+
* 📚[Dataset Download](https://huggingface.co/datasets/yuyijiong/Long-Instruction-with-Paraphrasing)
|
| 16 |
+
* ✨[GitHub](https://github.com/yuyijiong/train_with_paraphrasing)
|
| 17 |
+
|
| 18 |
## 训练方式
|
| 19 |
|
| 20 |
* 使用 NTK-aware 方法扩展上下文长度至 **32k**
|