File size: 961 Bytes
a282888
 
0b4c495
a282888
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
90247c5
a282888
 
 
 
 
 
 
 
90247c5
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
---
language:
- zh
- en
pipeline_tag: text-generation
tags:
- qwen 
- qwen-chat-1_8B
- rkllm
- rk3588
---

# Qwen-chat-1_8B-rkllm 
This is a conversion from [Qwen-1_8B-Chat](https://huggingface.co/Qwen/Qwen-1_8B-Chat) to the RKLLM format for chat in Rockchip devices. 


- [Qwen-chat-1\_8B-rkllm](#qwen-chat-1_8b-rkllm)
  - [Support Devices](#support-devices)
  - [Convert tools](#convert-tools)
  - [Converted with RKLLM runtime](#converted-with-rkllm-runtime)
  - [License](#license)
  - [Reference](#reference)


## Support Devices
* RK3588/RK3588s

## Convert tools
To Converting LLMs for Rockchip's NPUs, please see the artical<sup>1,2</sup> for model details.

## Converted with RKLLM runtime
*  RKLLM runtime `1.0.1`

## License
Same as the original [Qwen-1_8B-Chat](https://huggingface.co/Qwen/Qwen-1_8B-Chat)

## Reference
1. [airockchip/rknn-llm](https://github.com/airockchip/rknn-llm)
1. [Pelochus/ezrknn-llm](https://github.com/Pelochus/ezrknn-llm)