runtime error
00/124 [00:00<?, ?B/s][A generation_config.json: 100%|██████████| 124/124 [00:00<00:00, 755kB/s] WARNING:root:Some parameters are on the meta device device because they were offloaded to the disk and cpu. /home/user/.local/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cadam32bit_grad_fp32 adapter_model.safetensors: 0%| | 0.00/101M [00:00<?, ?B/s][A adapter_model.safetensors: 100%|█████████▉| 101M/101M [00:00<00:00, 113MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 40, in <module> peft_model = PeftModel.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/peft/peft_model.py", line 352, in from_pretrained model.load_adapter(model_id, adapter_name, is_trainable=is_trainable, **kwargs) File "/home/user/.local/lib/python3.10/site-packages/peft/peft_model.py", line 722, in load_adapter dispatch_model( File "/home/user/.local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 445, in dispatch_model model.to(device) File "/home/user/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1160, in to return self._apply(convert) File "/home/user/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 810, in _apply module._apply(fn) File "/home/user/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 810, in _apply module._apply(fn) File "/home/user/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 810, in _apply module._apply(fn) [Previous line repeated 5 more times] File "/home/user/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 833, in _apply param_applied = fn(param) File "/home/user/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1158, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) NotImplementedError: Cannot copy out of meta tensor; no data!
Container logs:
Fetching error logs...