xmod-base / tokenizer_config.json
jvamvas's picture
Copy XLM-R tokenizer to this repo
007e826
raw
history blame
48 Bytes
{
"tokenizer_class": "XLMRobertaTokenizer"
}