Help in downloading Mistral 7B

#166
by AmitKumarMallick1980 - opened

Dear Team, I am new to GenAI, LLMs and AI/ML. As part of our learning, we need to download and fine tune MISTRAL 7B model. When I check the model to download in hugging face, I see so many files. I am not sure which file I need to download basic pre-trained Mistral 7B model. Please suggest

Mistral AI_ org

Hi @AmitKumarMallick1980
It depends on what you will be using for inference!
A lot of the config files are related to the transformers implementation, and other files are the original weights, however if you use an inference library they usually already know what files to use. What are you trying to use?

Sign up or log in to comment