Hugging Face's logo

Spaces:
codellama
/
codellama-playground
Running

App Files Community
13

Should add <bos_id> token with infilling

#11
by Anditty - opened
Discussion
Anditty

https://github.com/facebookresearch/codellama/blob/main/llama/generation.py#L404

Anditty

Maybe we should organize the prompt like this: <BOS><PRE> {pre} <SUF>{suf} <MID>

ArthurZ
 Code Llama org

You can use the add_special_tokens = True to automatically add this

Sign up or log in to comment