Problem when impersonate on ST
#2
by
djuna
- opened
when impersonating the response start with always start with
<|start_header_id|>assistant<|end_header_id|>
...
maybe hermes problem?
wonder if copying Noraian config and tokenizer will fix this
gotcha, so this model expect after assistant response is user response. this will happen when
- system message after assistant
- or nothing after assistant (without user message)