Neuracraft / tokenizer_config.json
Erfan11's picture
Update tokenizer_config.json
f84e164 verified
raw
history blame
79 Bytes
{
"model_max_length": 512,
"padding": "max_length",
"truncation": true
}