book-description-generation / added_tokens.json
hungnm's picture
add tokenizer
ce49d8e
raw
history blame contribute delete
78 Bytes
{
"<|endoftitle|>": 50259,
"<|pad|>": 50258,
"<|startoftext|>": 50257
}