Configurable vit parameters

#68

Should this be like the proposed change?

I'm trying to do model = AutoModelForCausalLM.from_pretrained('microsoft/Florence-2-large', trust_remote_code=True, vision_config={'some_vision_option': some_value})

gmastrapas changed pull request title from Update configuration_florence2.py to Configurable vit parameters

And getting AssertionError: only DaViT is supported for now cause apparently model_type == '' in PretrainedConfig

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment