TheBloke
/

Guanaco-33B-SuperHOT-8K-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Guanaco-33B-SuperHOT-8K-GPTQ

1 contributor

History: 13 commits

TheBloke's picture

Add config.json, Llama modelling code and monkey patch

8d776b4 over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

7.13 kB

Add config.json, Llama modelling code and monkey patch over 1 year ago
config.json

828 Bytes

Add config.json, Llama modelling code and monkey patch over 1 year ago
generation_config.json

132 Bytes

Initial GPTQ model commit over 1 year ago
guanaco-33b-superhot-8k-GPTQ-4bit--1g.act.order.safetensors

16.9 GB
LFS

Initial GPTQ model commit over 1 year ago
llama_rope_scaled_monkey_patch.py

2.59 kB

Add config.json, Llama modelling code and monkey patch over 1 year ago
modelling_llama.py

39.5 kB

Add config.json, Llama modelling code and monkey patch over 1 year ago
quantize_config.json

133 Bytes

Initial GPTQ model commit over 1 year ago
special_tokens_map.json

289 Bytes

Initial GPTQ model commit over 1 year ago
tokenizer.json

1.84 MB

Initial GPTQ model commit over 1 year ago
tokenizer.model

500 kB
LFS

Initial GPTQ model commit over 1 year ago
tokenizer_config.json

715 Bytes

Initial GPTQ model commit over 1 year ago