Support is not provided
NotImplementedError: Unsloth: unsloth/gemma-2-9b-bnb-4bit not supported yet!
I have the same issue while runnig the code:
model, tokenizer = FastLanguageModel.from_pretrained(
model_name = "unsloth/gemma-2-9b-bnb-4bit",
max_seq_length = max_seq_length,
dtype = None,
load_in_4bit = True)
Any one can help address this issue (I noticed models are exists on huggingface unsloth)
thanks.
NotImplementedError: Unsloth: unsloth/gemma-2-9b-bnb-4bit not supported yet!
I have the same issue while runnig the code:
model, tokenizer = FastLanguageModel.from_pretrained(
model_name = "unsloth/gemma-2-9b-bnb-4bit",
max_seq_length = max_seq_length,
dtype = None,
load_in_4bit = True)Any one can help address this issue (I noticed models are exists on huggingface unsloth)
thanks.
We now support it now! Please read our blogpost for more information!
Blog: https://unsloth.ai/blog/gemma2
Tweet: https://x.com/UnslothAI/status/1808621282893910444