jim's picture

7 1 37

jim

jmjzz

·

AI & ML interests

None yet

Organizations

None yet

jmjzz's activity

New activity in PrunaAI/dbrx-instruct-bnb-4bit 8 months ago

generation is not good

#2 opened 8 months ago by

New activity in databricks/dbrx-instruct 8 months ago

OSError: You are trying to access a gated repo. Make sure to have access to it at https://huggingface.co/databricks/dbrx-instruct.

#33 opened 8 months ago by

The fused expert parameters means load_in_4bit doesn't work properly, nor does LoRA

#10 opened 8 months ago by

New activity in databricks/dbrx-instruct 8 months ago

We can't copy/paste?

#3 opened 8 months ago by

New activity in Crystalcareai/GemMoE-Base-Random 8 months ago

from_pretrained() extremely slow

#5 opened 8 months ago by

Inference code

#1 opened 8 months ago by

New activity in Crystalcareai/GemMoE-Beta-1 8 months ago

Memory requirement

#4 opened 8 months ago by

Memory requirement

#4 opened 8 months ago by