|
--- |
|
tags: |
|
- phi3 |
|
- phi3-mini |
|
- rkllm |
|
- rockchip |
|
- rk3588 |
|
--- |
|
|
|
# Microsoft's Phi-3 mini (4K instruct) for RK3588 |
|
This is a conversion from https://huggingface.co/microsoft/phi-3-mini-4k-instruct to the RKLLM format for Rockchip devices. |
|
This runs on the NPU from the RK3588. |
|
|
|
**Latest update:** 9th May 2024. Converted with **RKLLM runtime 1.0.1**. |
|
|
|
# Main repo |
|
See this for my full collection of converted LLMs for the RK3588's NPU: |
|
|
|
https://huggingface.co/Pelochus/ezrkllm-collection |
|
|
|
# License |
|
Same as the original LLM, in this case MIT: |
|
|
|
https://huggingface.co/microsoft/Phi-3-mini-4k-instruct |
