luffycodes's picture
Upload tokenizer
6ae5347
raw
history blame contribute delete
79 Bytes
{
"</HAL>": 32000,
"</s>": 2,
"<HAL>": 32001,
"<s>": 1,
"<unk>": 0
}