Running out of memory on dual RTX 3090 setup with unsloth
#1
by
Juanps90
- opened
Hello. I am not sure whether this is the right place, but I'm having issues when trying to run the provided notebook on my computer. It just runs out of memory on a fully free RTX 3090 when trying to finetune this model. My computer has dual RTX3090's but I'm not sure whether the free unsloth can take advantage of it.
Have the same thruble
having also issues with my rtx 4080 super
Sorry but unsloth currently only works on a single GPU. We will be rolling out multi GPU soon enough hopefully