radm
/

Athene-70B-bnb-4bit

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Edit model card

Athene-Llama3-70B-bnb-4bit

bitsandbytes 4bit version of Nexusflow Athene-Llama3-70B

Downloads last month: 2

Safetensors

Model size

37.4B params

Tensor type

F32

·

BF16

·

U8

·

Inference API

Unable to determine this model’s pipeline type. Check the docs .