SafeMathBot / added_tokens.json
lichenglu's picture
Move tokenizer files to root
95739ab
raw
history blame contribute delete
308 Bytes
{"[SAFE]": 50257, "[OK]": 50259, "<eos>": 50272, "[PARTNER_M]": 50263, "[PARTNER_F]": 50264, "<speaker2>": 50270, "[PARTNER_N]": 50265, "[SELF_N]": 50262, "[UNSAFE]": 50258, "<speaker1>": 50269, "[SELF_M]": 50260, "[ABOUT_M]": 50266, "<bos>": 50271, "[SELF_F]": 50261, "[ABOUT_N]": 50268, "[ABOUT_F]": 50267}