Chat template is removed in the base variant. Can we still use chat template to formulate the prompt?
#12
by
hxgy610
- opened
As indicated by title.
I think it doesn't make a lot of sense to add one, it's only a few tokens one needs to add.
Do you know if it is still okay to use special tokens in chat template to formulate input to query the base VLM ?
I think except for chat template tokens like start header id, end header id yes, beginning of sentence, eot_id and image tokens should be used.