Issue in tokenizer_config.json file

#7
by Mit1208 - opened

Hi @TheBloke ,
I was trying to load tokenizer from this model card. I am getting below error:

JSONDecodeError: Expecting value: line 52 column 16 (char 1146)

I compared file with the original model https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca/blob/main/tokenizer_config.json and found that issue is with the "padding". Shouldn't be it null?

After changing padding to null in my local, I can able to load model.

Am I missing something?

You're right, that's a misformed JSON file. I'll fix it

Issue should now be resolved, please try downloading again

Mit1208 changed discussion status to closed

Thanks, working as expected.

Sign up or log in to comment