Wrong EOS in the generation config?

#8
by urikz - opened

Hi!

The generation config sets bos_token_id and eos_token_id to be 49152, which seems off given that vocabulary size is 49152. Shall both of these be 0 instead?

Sign up or log in to comment