Unbabel

/

TowerInstruct-Mistral-7B-v0.2

like 8

Here are 2 examples found in ToowerBlocks:

{'conversations': [{'from': 'human', 'value': 'Source: Orlando Bloom and Miranda Kerr still love each other\nTranslate the source text from English to German.\nTarget: '}, {'from': 'gpt', 'value': 'Orlando Bloom und Miranda Kerr lieben sich noch immer'}], 'lang': 'en-de', 'split': 'dev', 'dataset': 'general_mt_clean', 'task': 'machine_translation'}
{'conversations': [{'from': 'human', 'value': 'From English to German, translate the text:\nSource: The heavily armoured dinosaur used red and white camouflage to hide from predators, and employed a shielding technique known as counter-shading, which is also used by many modern-day animals.\nTarget: '}, {'from': 'gpt', 'value': 'Der stark gepanzerte Dinosaurier verwendete eine rote und weiße Tarnung, um sich vor Raubtieren zu verstecken, und verwendete eine Abschirmungstechnik, die als Gegenbeschattung bekannt ist, die auch von vielen modernen Tieren verwendet wird.'}], 'lang': 'en-de', 'split': 'dev', 'dataset': 'general_mt_clean', 'task': 'machine_translation'}

I have two big questions:

1. in the dataset we see the from with "human" and "gpt" but in the model card you mention "user" and "assistant" did you actually transform all fileds in user/assistant to train TowerInstruct ?

2. The instructions vary a lot. In the first example you see the instruction "Translate" avec the source text, and it says "Source" "Traget" instead of "English" and "German" as per the model card. Inthe second example, instruction is before but not exacty as per model card.

Did you use the Towerblocks dataset as is or did you perfom some kind of preprocessing ?

Thanks