Train to GPT-2 with own data

#73
by JeisonJimenez - opened

I would like to train gpt-2 with my documents to be able to ask questions about this information, what format should I give to my dataset?

Hi @JeisonJA
Thanks for your interest!
You might be interested in using SFTTrainer from TRL library: https://huggingface.co/docs/trl/sft_trainer let me know if you have any question

Sign up or log in to comment