Error when loading about bias
#2
by
jackboot
- opened
File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/exllamav2-0.1.7-py3.10-linux-x86_64.egg/exllamav2/linear.py", line 111, in load
assert "bias" in w, self.key + " has no bias but bias expected"
AssertionError: model.layers.0.self_attn.q_proj has no bias but bias expected
I am using 5.0bpw.
nvm, files were corrupted
jackboot
changed discussion status to
closed