How to increase max token output ?
#40
by
Truc95
- opened
Hello,
While using Florence-2 for OCR tasks, the maximum token output is easily reached - around 400 words.
Is it possible to increase the maximum output ? I have tried to change both max_new_tokens which has no effect.
I have tried "max_position_embeddings" but it seems that changing this parameter would require a retraining of the model.
Is there any way to increase the output tokens ?
It's not possible, the max token trained are limited to 1024