Hugging Face's logo

Spaces:
open-llm-leaderboard
/
open_llm_leaderboard
Running on CPU Upgrade

App Files Community
1012

airoboros-110b-3.3 disappeared after running?

#746
by jondurbin - opened
Discussion
jondurbin

I submitted airoboros-110b-3.3 for benchmarking a couple days ago, and after being in the running queue for some time it seems to have vanished. I don't see it in the leaderboard, running queue/etc., and it doesn't seem to have an error status either. Mind taking a look?

alozowski
 Open LLM Leaderboard org

Hi @jondurbin !

Could you please provide the request file for your model?

Weyaxi

Here is the request file for that model:

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/jondurbin/airoboros-110b-3.3_eval_request_False_bfloat16_Original.json

alozowski
 Open LLM Leaderboard org

Thank you for providing the request file! According to the log, the evaluation for your model failed thus you don't see it in the Leaderboard. I resubmitted it, so it should be fine

I'll close this issue, please, feel free to ping me here if you need any help with this model

alozowski changed discussion status to closed

Sign up or log in to comment