phymbert
/

dbrx-16x12b-instruct-iq3_s-gguf

Inference Endpoints

Model card Files Files and versions Community

Edit model card

This is the iq3_s quantum model for llama.cpp:

https://github.com/ggerganov/llama.cpp/pull/6515

Downloads last month: 6

GGUF

Model size

132B params

Architecture

dbrx

3-bit

Inference API

Unable to determine this model's library. Check the docs .

Collection including phymbert/dbrx-16x12b-instruct-iq3_s-gguf

dbrx-16x12b-instruct-gguf

GGUF quantum models for DBRX: https://github.com/ggerganov/llama.cpp • 6 items • Updated Apr 14 • 1