TheBloke
/

Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

AWQ support

#8

by Prasanna-IQ - opened Dec 21, 2023

Dec 21, 2023

Hi @TheBloke , Any idea when we will get AWQ variant of this model and AWQ support with TGI for this model.
Thanks!!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment