File size: 531 Bytes
89295a2
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12

**Where to send questions or comments about the model:**
https://github.com/LargeWorldModel/lwm/issues

## Training dataset
- Books3 dataset
- 700B text-image pairs from Laion-2B-en, filtered to only keep images with at least 256 resolution
- 400M text-image pairs from COYO-700M, filtered to only keep images with at least 256 resolution
- 10M text-video pairs from WebVid10M
- 3M text-video pairs from a subset of InternVid10M
- 73K text-video chat pairs from Valley-Instruct-73K 
- 100K text-video chat pairs from Video-ChatGPT