ValueError: The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this architecture

#39
by KevalRx - opened

I get an error when running this code sample from Transformers library:

# Load model directly
from transformers import AutoProcessor, AutoModelForPreTraining

processor = AutoProcessor.from_pretrained("meta-llama/Llama-3.2-11B-Vision")
model = AutoModelForPreTraining.from_pretrained("meta-llama/Llama-3.2-11B-Vision")

Error:

---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
/usr/local/lib/python3.10/dist-packages/transformers/models/auto/configuration_auto.py in from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
    992             try:
--> 993                 config_class = CONFIG_MAPPING[config_dict["model_type"]]
    994             except KeyError:

3 frames
/usr/local/lib/python3.10/dist-packages/transformers/models/auto/configuration_auto.py in __getitem__(self, key)
    694         if key not in self._mapping:
--> 695             raise KeyError(key)
    696         value = self._mapping[key]

KeyError: 'mllama'

During handling of the above exception, another exception occurred:

ValueError                                Traceback (most recent call last)
<ipython-input-18-bc2ee643b38e> in <cell line: 2>()
      1 # Load model
----> 2 processor = AutoProcessor.from_pretrained("meta-llama/Llama-3.2-11B-Vision")
      3 model = AutoModelForPreTraining.from_pretrained("meta-llama/Llama-3.2-11B-Vision")

/usr/local/lib/python3.10/dist-packages/transformers/models/auto/processing_auto.py in from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
    290             # Otherwise, load config, if it can be loaded.
    291             if not isinstance(config, PretrainedConfig):
--> 292                 config = AutoConfig.from_pretrained(
    293                     pretrained_model_name_or_path, trust_remote_code=trust_remote_code, **kwargs
    294                 )

/usr/local/lib/python3.10/dist-packages/transformers/models/auto/configuration_auto.py in from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
    993                 config_class = CONFIG_MAPPING[config_dict["model_type"]]
    994             except KeyError:
--> 995                 raise ValueError(
    996                     f"The checkpoint you are trying to load has model type `{config_dict['model_type']}` "
    997                     "but Transformers does not recognize this architecture. This could be because of an "

ValueError: The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

Were you able to figure out?

Sign up or log in to comment