RITA_tokenizer / tokenizer_config.json
DanielHesslow's picture
add tokenizer
5dac2c2
raw
history blame contribute delete
46 Bytes
{"tokenizer_class": "PreTrainedTokenizerFast"}