gpt2-small-bg / added_tokens.json
rmihaylov's picture
add tokenizer
5bdc38e
raw
history blame contribute delete
81 Bytes
{"[CLS]": 50257, "[SEP]": 50258, "[MASK]": 50260, "<unk>": 50261, "<pad>": 50259}