gpt2-small-bgwiki / added_tokens.json
auhide's picture
Upload tokenizer
aa34518
raw
history blame contribute delete
No virus
93 Bytes
{
"[CLS]": 50257,
"[EOL]": 50260,
"[EOS]": 50261,
"[PAD]": 50259,
"[SEP]": 50258
}