How to run this across two GPUs with transformers/accelerate?

by mvetter - opened Jun 20

Jun 20

For some reason this will not run for me using accelerate, no matter the config transformers will only allocate the model to a single GPU.

Is there a model specific reason for this?

mvetter changed discussion status to closed Jun 20

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment