how to make the repsonses consistent?
#70
by
wwdd7718
- opened
for the same image and prompt, I got different responses from the model. I've tried to set the temperature to 0, but it seems that temperature must be positive. I also tried to include seed to reproduce, but got nowhere to specify the seed parameter.
Try adding 'do_sample=False'.
output = model.generate(
**inputs,
max_new_tokens=100,
do_sample=False,
)