Which version of transformers works with this model?

#66
by aw632 - opened

The model card says to use ToT transformers from source, not any of the releases. Is that still accurate? If so, which commit to transformers contains the fixes for this model?

I am interested in knowing this as well. I believe it is still true that you need to install from source, but I would be very curious in knowing if version 4.43.4 works.

EDIT:
According to this post here: https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407/discussions/35#66ac8897a990031a0b46ab9c

Versions above 4.42.4 should be compatible. I will need to verify if this is true.

I am interested in knowing this as well. I believe it is still true that you need to install from source, but I would be very curious in knowing if version 4.43.4 works.

EDIT:
According to this post here: https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407/discussions/35#66ac8897a990031a0b46ab9c

Versions above 4.42.4 should be compatible. I will need to verify if this is true.

I can confirm now that version 4.43.4 of transformers seems to be able to load weights correctly for Mistral-Nemo. Not seeing the errors I saw with earlier versions.

Sign up or log in to comment