OrionStarAI
/

Orion-14B-Base-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

renillhuang commited on Jan 25

Commit

21afd33

•

1 Parent(s): 2a041f9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -278,7 +278,7 @@ CUDA_VISIBLE_DEVICES=0 python demo/text_generation_base.py --model OrionStarAI/O
 CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-14B-Chat --tokenizer OrionStarAI/Orion-14B-Chat --prompt hi
 ```
 ## 4.4. Inference by vllm
 - Project URL<br>

 CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-14B-Chat --tokenizer OrionStarAI/Orion-14B-Chat --prompt hi
 ```
+<a name="vllm"></a><br>
 ## 4.4. Inference by vllm
 - Project URL<br>