Transformers
mpt
Composer
MosaicML
llm-foundry

Add Q2_K as well

#1
by Sidharthkr - opened

If possible add Q2_K version in both chat and instruct models.

Sidharthkr changed discussion title from Please add Q2_K as well to Add Q2_K as well

Sign up or log in to comment