Added example to run on smaller GPUS
#1
by
buzzcraft
- opened
Current setup would not run on A10's, so added an example that would allow it to run in on T4 (16GB gpus)
Hi, thank you very much, this is very useful information for a lot of people :)
davda54
changed pull request status to
merged
That's a great idea, I added sharded safetensor weights to all three repositories, now they run in a free-tier Colab notebook. Thanks!