megatron-bert-base-swedish-cased-125k / tokenizer_config.json
JoeyOhman's picture
add tokenizer
7b13d23
raw
history blame
159 Bytes
{"special_tokens_map_file": "pretrained_model_hf/special_tokens_map.json", "name_or_path": "pretrained_model_hf", "tokenizer_class": "PreTrainedTokenizerFast"}