tmpupload
/

superhot-30b-8k-no-rlhf-test-128g-GPTQ

Text Generation

Inference Endpoints

Model card Files Files and versions Community

tmpupload commited on Jun 27, 2023

Commit

eb12e5f

•

1 Parent(s): 6c3a855

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@ license: other
 ---
 # superhot-30b-8k-4bit-128g-safetensors
-**Note: Maximum sequence length (max_seq_len) and compression factor (compress_pos_emb) need to be set to 8192 and 4.**
 Merged base LLaMA and LoRA with this:
 https://github.com/tloen/alpaca-lora

 ---
 # superhot-30b-8k-4bit-128g-safetensors
+**Note: Maximum sequence length (max_seq_len) and compression factor (compress_pos_emb) need to be set to 8192 (or lower) and 4.**
 Merged base LLaMA and LoRA with this:
 https://github.com/tloen/alpaca-lora