leafspark
/

L3.1-70B-Celeste-v0.1-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Edit model card

L3.1-70B-Celeste-v0.1-GGUF

GGUF quants of nothingiisreal/L3.1-70B-Celeste-V0.1-BF16

Made with AutoGGUF

Quantization	Size
q5_k_m	49.9GB

Downloads last month: 34

GGUF

Model size

70.6B params

Architecture

llama

3-bit

4-bit

5-bit

Inference Examples

Text Generation

Inference API (serverless) does not yet support ggml models for this pipeline type.

Datasets used to train leafspark/L3.1-70B-Celeste-v0.1-GGUF