summary_loop46 / special_tokens_map.json
philippelaban's picture
Adding tokenizer & model files
6edc9ac
raw
history blame
89 Bytes
{"bos_token": "ĠST", "eos_token": "END", "unk_token": "<|endoftext|>", "pad_token": "!"}