Would be nice to have the openchat.json config directly in the repo

#2
by mlaprise - opened

I'm trying to test the model using the openchat api server:

python -m ochat.serving.openai_api_server --model berkeley-nest/Starling-LM-7B-alpha.

Looks like the code is looking for the openchat.json file:

Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/home/mlaprise/miniconda3/envs/openchat/lib/python3.11/site-packages/ochat/serving/openai_api_server.py", line 348, in
with open(cached_file(path_or_repo_id=args.model, filename="openchat.json"), "r") as f:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/mlaprise/miniconda3/envs/openchat/lib/python3.11/site-packages/transformers/utils/hub.py", line 481, in cached_file
raise EnvironmentError(
OSError: berkeley-nest/Starling-LM-7B-alpha does not appear to have a file named openchat.json. Checkout 'https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha/main' for available files.

Berkeley-Nest org

Thank you for the comment! I just copied their openchat.json and uploaded here!

banghua changed discussion status to closed

Sign up or log in to comment