README.md

---
license: apache-2.0
language:
- en
- zh
tags:
- rk3588
- rkllm
- Rockchip
- internlm2
---

# internlm2_rkLLM

- [中文](#书生浦语-18b)
- [English](#internlm2-18b)

## 书生·浦语-1.8B

### 介绍

internlm2_rkLLM 是从 [internlm2-chat-1_8b](https://huggingface.co/internlm/internlm2-chat-1_8b) 转换而来的 RKLLM 模型，专为 Rockchip 设备优化。该模型运行于 RK3588 的 NPU 上。

- **模型名称**: internlm2-chat-1_8b
- **模型架构**: 与 internlm2-chat-1_8b 相同
- **发布者**: FydeOS
- **日期**: 2024-06-03

### 模型详情

书生·浦语-1.8B (InternLM2-1.8B) 是第二代浦语模型系列的18亿参数版本。通过在线 RLHF 在 InternLM2-Chat-1.8B-SFT 之上进一步对齐。 InternLM2-Chat-1.8B表现出更好的指令跟随、聊天体验和函数调用，推荐下游应用程序使用。

InternLM2 模型具备以下的技术特点:
- 有效支持20万字超长上下文：模型在20万字长输入中几乎完美地实现长文“大海捞针”，而且在 LongBench 和 L-Eval 等长文任务中的表现也达到开源模型中的领先水平。
- 综合性能全面提升：各能力维度相比上一代模型全面进步，在推理、数学、代码等方面的能力提升显著。
### 使用指南

> 此模型仅支持搭载 Rockchip RK3588/s 芯片的设备。请确认设备信息并确保 NPU 可用。

#### openFyde 系统

> 请确保你已将系统升级到最新版本。

1. 下载模型文件 `XXX.rkllm`。
2. 新建文件夹 `model/`，将模型文件放置于该文件夹内。
3. 启动 FydeOS AI，在设置页面进行相关配置。

#### 其它系统
> 请确保已完成 RKLLM 的 NPU 相关内核更新。

1. 下载模型文件 `XXX.rkllm`。
2. 按照官方文档进行配置：[官方文档](https://github.com/airockchip/rknn-llm)。

### 常见问题（FAQ）

如遇到问题，请先查阅 issue 区，若问题仍未解决，再提交新的 issue。

### 限制与注意事项

- 模型在某些情况下可能存在性能限制
- 使用时请遵循相关法律法规
- 可能需要进行适当的参数调优以达到最佳效果

### 许可证

本模型采用与 [internlm2-chat-1_8b](https://huggingface.co/internlm/internlm2-chat-1_8b) 相同的许可证。

### 联系方式

如需更多信息，请联系：

- **电子邮件**: [email protected]
- **主页**: [FydeOS AI](https://fydeos.ai/zh/)


## InternLM2-1.8B

### Introduction

internlm2_rkLLM is a RKLLM model derived from [internlm2-chat-1_8b](https://huggingface.co/internlm/internlm2-chat-1_8b), specifically optimized for Rockchip devices. This model operates on the NPU of the RK3588 chip.

- **Model Name**: internlm2-chat-1_8b
- **Architecture**: Identical to internlm2-chat-1_8b
- **Publisher**: FydeOS
- **Release Date**: 3 June 2024

### Model Details

InternLM2-1.8B is the 1.8 billion parameter version of the second generation InternLM series. Further aligned on top of InternLM2-Chat-1.8B-SFT through online RLHF. InternLM2-Chat-1.8B exhibits better instruction following, chat experience, and function calling, which is recommended for downstream applications. 

The InternLM2 has the following technical features:

- Effective support for ultra-long contexts of up to 200,000 characters: The model nearly perfectly achieves "finding a needle in a haystack" in long inputs of 200,000 characters. It also leads among open-source models in performance on long-text tasks such as LongBench and L-Eval.
- Comprehensive performance enhancement: Compared to the previous generation model, it shows significant improvements in various capabilities, including reasoning, mathematics, and coding.

### User Guide

This model is only supported on devices with the Rockchip RK3588/s chip. Please verify your device's chip information and ensure the NPU is operational.

#### openFyde System

> Ensure you have upgraded to the latest version of openFyde.

1. Download the model file `XXX.rkllm`.
2. Create a folder named `model/` and place the model file inside this folder.
3. Launch FydeOS AI and configure the settings on the settings page.

#### Other Systems

> Ensure you have updated the NPU kernel related to RKLLM.

1. Download the model file `XXX.rkllm`.
2. Follow the configuration guidelines provided in the [official documentation](https://github.com/airockchip/rknn-llm).

### FAQ

If you encounter issues, please refer to the issue section first. If your problem remains unresolved, submit a new issue.

### Limitations and Considerations

- The model may have performance limitations in certain scenarios.
- Ensure compliance with relevant laws and regulations during usage.
- Parameter tuning might be necessary to achieve optimal performance.

### License

This model is licensed under the same terms as [internlm2-chat-1_8b](https://huggingface.co/internlm/internlm2-chat-1_8b).

### Contact Information

For more information, please contact:

- **Email**: [email protected]
- **Homepage**: [FydeOS AI](https://fydeos.ai/en/)