File size: 2,595 Bytes
ca770e9 0b7a4d0 a1d0285 bdddd1b a1d0285 bdddd1b a1d0285 bdddd1b a1d0285 4727c2e a1d0285 bdddd1b a1d0285 bdddd1b deabee8 f8985fb deabee8 f8985fb deabee8 1158ae6 a1d0285 bdddd1b a1d0285 bdddd1b a1d0285 bdddd1b a1d0285 bdddd1b a1d0285 bdddd1b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 |
---
license: apache-2.0
datasets:
- jed351/cantonese-wikipedia
- raptorkwok/cantonese-traditional-chinese-parallel-corpus
language:
- zh
- en
pipeline_tag: text-generation
tags:
- Cantonese
- Qwen2
- chat
---
# Qwen2-Cantonese-7B-Instruct
## Model Overview / 模型概述
Qwen2-Cantonese-7B-Instruct is a Cantonese language model based on Qwen2-7B-Instruct, fine-tuned using LoRA. It aims to enhance Cantonese text generation and comprehension capabilities, supporting various tasks such as dialogue generation, text summarization, and question-answering.
Qwen2-Cantonese-7B-Instruct係基於Qwen2-7B-Instruct嘅粵語語言模型，使用LoRA進行微調。 它旨在提高粵語文本的生成和理解能力，支持各種任務，如對話生成、文本摘要和問答。
## Model Features / 模型特性
- **Base Model**: Qwen2-7B-Instruct
- **Fine-tuning Method**: LoRA instruction tuning
- **Training Steps**: 4572 steps
- **Primary Language**: Cantonese / 粵語
- **Datasets**:
- [jed351/cantonese-wikipedia](https://huggingface.co/datasets/jed351/cantonese-wikipedia)
- [raptorkwok/cantonese-traditional-chinese-parallel-corpus](https://huggingface.co/datasets/raptorkwok/cantonese-traditional-chinese-parallel-corpus)
- **Training Tools**: [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory)
## Quantized Version / 量化版本
A 4-bit quantized version of this model is also available: [qwen2-cantonese-7b-instruct-q4_0.gguf](https://huggingface.co/lordjia/Qwen2-Cantonese-7B-Instruct/blob/main/qwen2-cantonese-7b-instruct-q4_0.gguf).
此外，仲提供此模型嘅4位量化版本：[qwen2-cantonese-7b-instruct-q4_0.gguf](https://huggingface.co/lordjia/Qwen2-Cantonese-7B-Instruct/blob/main/qwen2-cantonese-7b-instruct-q4_0.gguf)。
## Alternative Model Recommendations / 備選模型舉薦
For alternatives, consider the following models, both fine-tuned by LordJia on Cantonese language tasks:
揾其他嘅話，可以諗下呢啲模型，全部都係LordJia用廣東話嘅工作調教好嘅：
1. [Llama-3-Cantonese-8B-Instruct](https://huggingface.co/lordjia/Llama-3-Cantonese-8B-Instruct) based on Meta-Llama-3-8B-Instruct.
2. [Llama-3.1-Cantonese-8B-Instruct](https://huggingface.co/lordjia/Llama-3.1-Cantonese-8B-Instruct) based on Meta-Llama-3.1-8B-Instruct.
## License / 許可證
This model is licensed under the Apache 2.0 license. Please review the terms before use.
此模型喺Apache 2.0許可證下獲得許可。 請在使用前仔細閱讀呢啲條款。
## Contributors / 貢獻
- LordJia [https://ai.chao.cool](https://ai.chao.cool/) |