gpt-neox-tokenizer-digits / tokenizer_config.json
michaelkrumdickkensho's picture
Upload tokenizer_config.json
dbb047a
raw
history blame contribute delete
47 Bytes
{"tokenizer_class": "PreTrainedTokenizerFast"}