JayhC
/

NoromaidxOpenGPT4-2-4.5bpw-h6-exl2

Text Generation

Not-For-All-Audiences

nsfw

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (0)

Is there a chance that a lower bpw version of this can be created to fit on a single 24GB vram GPU?

#2 opened 7 months ago by

Measurements.json next time please!

#1 opened 7 months ago by

ProphetOfBostrom