LavaPlanet
/

Venus-120b-v1.1-exl2_2-2.64bpw

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

LavaPlanet commited on Dec 15, 2023

Commit

f7db008

•

1 Parent(s): 13169f1

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -1,3 +1,4 @@
 ---
 license: llama2
 ---

 ---
 license: llama2
 ---
+This should fit on 2x3090s on windows with a 18-19,24 gpu split with 6k-8k context. Uses the new exlv2 quant