Which basemodel?

#1
by Dietmar2020 - opened

Open_Llama does not work:
RuntimeError: Error(s) in loading state_dict for PeftModelForCausalLM:
size mismatch for base_model.model.lm_head.modules_to_save.shahules786_open-llama-7B-orcastyle.weight: copying a param with shape torch.Size([32002, 4096]) from checkpoint, the shape in current model is torch.Size([32000, 4096]).

Sign up or log in to comment