emeraldgoose
/

bad-korean-tokenizer

Inference Endpoints

Model card Files Files and versions Community

bad-korean-tokenizer / special_tokens_map.json

minseong's picture

add tokens

f65d960 almost 3 years ago

history blame contribute delete

134 Bytes

	{
	"unk_token": "[UNK]",
	"sep_token": "[SEP]",
	"pad_token": "[PAD]",
	"cls_token": "[CLS]",
	"mask_token": "[MASK]"
	}