TheBloke
/

Llama-2-70B-Chat-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Llama-2-70B-Chat-GPTQ / config.json

Commit History

Update config.json

054fbf6

TheBloke commited on Aug 20, 2023

Update for Transformers GPTQ support

0c522b8

TheBloke commited on Aug 20, 2023

Update config.json

17d2822

TheBloke commited on Jul 25, 2023

Update config.json

9e32926

TheBloke commited on Jul 23, 2023

Initial GPTQ model commit

bce3ae1

TheBloke commited on Jul 19, 2023