**Where to send questions or comments about the model:** https://github.com/LargeWorldModel/lwm/issues ## Training dataset - Books3 dataset - 700B text-image pairs from Laion-2B-en, filtered to only keep images with at least 256 resolution - 400M text-image pairs from COYO-700M, filtered to only keep images with at least 256 resolution - 10M text-video pairs from WebVid10M - 3M text-video pairs from a subset of InternVid10M - 73K text-video chat pairs from Valley-Instruct-73K - 100K text-video chat pairs from Video-ChatGPT