hidden_activation vs hidden_act in config.json

#10

by heheda - opened Sep 22

Sep 22

Llama 3.1 uses hidden_act to specify the activation function, while this model uses hidden_activation. Can you change the hidden_activation to hidden_act to help vllm reuse the code of llama 3.1?

ArthurZ

Meta Llama org Sep 22

For sure

heheda

Sep 22

Thanks!

heheda changed discussion status to closed Sep 22

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment