wav2vec2-large-voxrex-swedish / tokenizer_config.json
marma's picture
Update tokenizer_config.json
80db955
raw
history blame
211 Bytes
{
"bos_token" : "<s>",
"do_lower_case" : true,
"eos_token" : "</s>",
"pad_token" : "<pad>",
"tokenizer_class" : "Wav2Vec2CTCTokenizer",
"unk_token" : "<unk>",
"word_delimiter_token" : "|"
}