Error
2024/02/09 16:05:26 ~ File "/opt/conda/lib/python3.9/site-packages/transformers/dynamic_module_utils.py", line 538, in resolve_trust_remote_code
2024/02/09 16:05:26 ~ answer = input(
2024/02/09 16:05:26 ~ EOFError: EOF when reading a line
nsine 2024-02-09T22:05:26.191+00:00
2024/02/09 16:05:26 ~ Application startup failed. Exiting.
2024/02/09 16:05:26 ~ Do you accept? [y/N]
For the huggingface library inference, please use instead : https://huggingface.co/RWKV/HF_v5-Eagle-7B
Hi Eugene! Heard a podcast you did, it was really good. I've tried using that, got the same results. To be more verbose, I'm trying to deploy via HF's Inference Endpoints
Have you tested HF's endpoint deployment?
I tried with TGI and it does not work. Can you please add support for HF's TGI?
@rileyjohnson - only tested hugging face transformer library - sorry, not too used to the rest of the HF eco-system (it might need the rwkv v5 PR merge im guessing?)