mosaicml

/

mpt-7b-chat

like 512

Follow

Mosaic ML, Inc. 351

Manually tested with

from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained('mpt-7b-chat-tokenizer')

chat = [
    {"role": "system", "content": "This is a prompt!"},
   {"role": "user", "content": "Hello, how are you?"},
   {"role": "assistant", "content": "I'm doing great. How can I help you today?"},
   {"role": "user", "content": "I'd like to show off how chat templating works!"},
]

print(tokenizer.apply_chat_template(chat, tokenize=False))

where mpt-7b-chat tokenizer is a local folder that includes the modified tokenizer_config.json