Length of Summary

#5
by Shirin25 - opened

Could you let me know the attribute for changing the length of the output summary? Also, what's the maximum allowable length for the same?

Hi - sorry for the delay. I would recommend generating with Beam Search decoding for this model - please see the docs for that here

tl;dr you will want to pass max_length=<integer of tokens max output you want> and min_length=<integer of tokens minimum output you want> max input length for this model is 4096 tokens and max output is 1024

Sign up or log in to comment