hf-internal-testing

/

flux.1-dev-nf4-pkg

like 10

Follow

Hugging Face Internal Testing Organization 77

Hi, I got some problems while running this optimization on cuda 12.2.
The bitsandbytes library can't be imported with it because it suits for cuda 11.
I tried to change some env variable as CUDA_VERSION and similar ones.

There is any solution for it? or maybe another optimization for this case?
Thanks.