the model class needs to implement the `_no_split_modules` attribute

#1
by entin - opened

Sziasztok / Hi,
Is there a workaround regarding this error?

env .. python3.12/site-packages/transformers/modeling_utils.py", line 1867, in _get_no_split_modules
raise ValueError(
ValueError: BertLMHeadModel does not support device_map='auto'. To implement support, the model class needs to implement the _no_split_modules attribute.

Sign up or log in to comment