LavaPlanet
/

Venus-120b-v1.1-exl2_2-2.64bpw

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Venus-120b-v1.1-exl2_2-2.64bpw / README.md

LavaPlanet's picture

Update README.md

f7db008 11 months ago

|

132 Bytes

	---
	license: llama2
	---
	This should fit on 2x3090s on windows with a 18-19,24 gpu split with 6k-8k context. Uses the new exlv2 quant