Hi!
The generation config sets bos_token_id and eos_token_id to be 49152, which seems off given that vocabulary size is 49152. Shall both of these be 0 instead?
· Sign up or log in to comment