THUDM

/

chatglm3-6b-base

like 87

Follow

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University 1,163

Hi, I tried to fine-tune using huggingface trainer, but I got following error message

  File "(My_Cache_File_Path)/modeling_chatglm.py", line 691, in get_masks
    full_attention_mask -= padding_mask.unsqueeze(-1) - 1
RuntimeError: Subtraction, the `-` operator, with a bool tensor is not supported. If you are trying to invert a mask, use the `~` or `logical_not()` operator instead.

transformers==4.34.0
torch==2.1.0