Change to base & fix duplicate flag
Browse files
README.md
CHANGED
@@ -298,13 +298,13 @@ CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-
|
|
298 |
- How to convert to GGUF model
|
299 |
|
300 |
```shell
|
301 |
-
python convert-hf-to-gguf.py path/to/Orion-14B-
|
302 |
```
|
303 |
|
304 |
- How to run generation
|
305 |
|
306 |
```shell
|
307 |
-
./main --frequency-penalty 0.5 --
|
308 |
```
|
309 |
|
310 |
## 4.6 Example Output
|
|
|
298 |
- How to convert to GGUF model
|
299 |
|
300 |
```shell
|
301 |
+
python convert-hf-to-gguf.py path/to/Orion-14B-Base --outfile base.gguf
|
302 |
```
|
303 |
|
304 |
- How to run generation
|
305 |
|
306 |
```shell
|
307 |
+
./main --frequency-penalty 0.5 --top-k 5 --top-p 0.9 -m base.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e
|
308 |
```
|
309 |
|
310 |
## 4.6 Example Output
|