Update README
Browse files
README.md
CHANGED
|
@@ -1,3 +1,11 @@
|
|
| 1 |
---
|
| 2 |
license: llama2
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: llama2
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+
Usage:
|
| 6 |
+
|
| 7 |
+
1. [Install OpenChat](https://github.com/imoneoi/openchat/#installation)
|
| 8 |
+
|
| 9 |
+
2. `python -m ochat.serving.openai_api_server --model-type openchat_llama2 --model Open-Orca/Llama2_GPT4_1M --engine-use-ray --worker-use-ray --max-num-batched-tokens 5120`
|
| 10 |
+
|
| 11 |
+
To use features such as tensor parallelism on consumer GPUs, API keys and logging, follow the OpenChat documentation.
|