Change to base & fix duplicate flag - ZH
#4
by
algorithm
- opened
- README_zh.md +2 -2
README_zh.md
CHANGED
@@ -286,13 +286,13 @@ CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-
|
|
286 |
- 如何转换GGUF格式模型
|
287 |
|
288 |
```shell
|
289 |
-
python convert-hf-to-gguf.py path/to/Orion-14B-
|
290 |
```
|
291 |
|
292 |
- 如何运行GGUF格式模型推理
|
293 |
|
294 |
```shell
|
295 |
-
./main --frequency-penalty 0.5 --
|
296 |
```
|
297 |
|
298 |
## 4.6. 示例输出
|
|
|
286 |
- 如何转换GGUF格式模型
|
287 |
|
288 |
```shell
|
289 |
+
python convert-hf-to-gguf.py path/to/Orion-14B-Base --outfile base.gguf
|
290 |
```
|
291 |
|
292 |
- 如何运行GGUF格式模型推理
|
293 |
|
294 |
```shell
|
295 |
+
./main --frequency-penalty 0.5 --top-k 5 --top-p 0.9 -m base.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e
|
296 |
```
|
297 |
|
298 |
## 4.6. 示例输出
|