Issue in tokenizer_config.json file
#7
by
Mit1208
- opened
Hi
@TheBloke
,
I was trying to load tokenizer from this model card. I am getting below error:
JSONDecodeError: Expecting value: line 52 column 16 (char 1146)
I compared file with the original model https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca/blob/main/tokenizer_config.json and found that issue is with the "padding". Shouldn't be it null?
After changing padding to null in my local, I can able to load model.
Am I missing something?
You're right, that's a misformed JSON file. I'll fix it
Issue should now be resolved, please try downloading again
Mit1208
changed discussion status to
closed
Thanks, working as expected.