Update README.md
Browse files
README.md
CHANGED
|
@@ -51,6 +51,7 @@ print(answer)
|
|
| 51 |
|
| 52 |
### Использование через vllm + openai client
|
| 53 |
|
|
|
|
| 54 |
`python -m vllm.entrypoints.openai.api_server --model Vikhrmodels/it-5.4-fp16-orpo-v2 --dtype half --api-key token-abc123 -tp 1`
|
| 55 |
|
| 56 |
```python
|
|
|
|
| 51 |
|
| 52 |
### Использование через vllm + openai client
|
| 53 |
|
| 54 |
+
Запуск сервера в терминале: \
|
| 55 |
`python -m vllm.entrypoints.openai.api_server --model Vikhrmodels/it-5.4-fp16-orpo-v2 --dtype half --api-key token-abc123 -tp 1`
|
| 56 |
|
| 57 |
```python
|