baichuan-inc

/

Baichuan2-7B-Base

like 77

Follow

Baichuan Intelligent Technology 258

At line 709 in modeling_baichuan.py: z_loss = self.config.z_loss_weight * softmax_normalizer.mean(), it attempts to use the attribute z_loss_weight, but the BaichuanConfig class in configuration_baichuan.py seems to have forgotten to define the z_loss_weight attribute.