Delay issue

#10
by jyoung105 - opened

Hello!
Thank you for setting this amazing space up.
I'd like to ask sth to you since this leaderboard becomes popular, there is a huge bottleneck to get a result.
So I suggest the rule of this board.

  1. Can't submit until one in pending queue is not evaluated yet regards to the nickname.
  2. When the model doesn't work within a few iterations, make it get failed and delete it on GPU.

Thank you once again!

upstage org

Hello,

Thank you for your suggestion. We will consider it.
To reduce bottlenecks, we will also consider efforts such as increasing the evaluation GPUs.

Thank you :)

μ•ˆλ…•ν•˜μ„Έμš”.

μ œμ•ˆ μ£Όμ‹  점에 κ°μ‚¬λ“œλ¦¬λ©°, κ²€ν† ν•˜λ„λ‘ ν•˜κ² μŠ΅λ‹ˆλ‹€.
병λͺ©μ„ 쀄이기 μœ„ν•΄ ν‰κ°€μš© GPUλ₯Ό λŠ˜λ¦¬λŠ” λ°©ν–₯도 ν•¨κ»˜ κ³ λ €ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€.

κ°μ‚¬ν•©λ‹ˆλ‹€. :)

Limerobot changed discussion status to closed

Sign up or log in to comment