Kunger
/

Sakura-13B-v0.11Pre-4Bit-AWQ

Text Generation

4-bit precision

Model card Files Files and versions Community

Sakura-13B-v0.11Pre-4Bit-AWQ / README.md

Kunger's picture

Update README.md

ac38a99 verified 8 months ago

|

history blame contribute delete

232 Bytes

metadata

license: cc-by-nc-sa-4.0

原始模型:Sakura-13B-LNovel-v0.11pre1

4Bit AWQ量化，未测试，不建议使用。

采用带有flash_attn的环境进行量化