hivemind

/

gpt-j-6B-8bit

like 131

Follow

hivemind 11

I'm getting the error when I run this line:
gpt = GPTJForCausalLM.from_pretrained("hivemind/gpt-j-6B-8bit", low_cpu_mem_usage=True)

/usr/local/lib/python3.10/dist-packages/transformers/modeling_utils.py:2608 in from_pretrained │
│ │
│ 2605 │ │ │
│ 2606 │ │ # Instantiate model. │
│ 2607 │ │ init_contexts = [no_init_weights(_enable=_fast_init)] │
│ ❱ 2608 │ │ │
│ 2609 │ │ if is_deepspeed_zero3_enabled(): │
│ 2610 │ │ │ import deepspeed │
│ 2611