Edit model card

QuantFactory/qwen2.5-7b-ins-v3-GGUF

This is quantized version of happzy2633/qwen2.5-7b-ins-v3 created using llama.cpp

Original Model Card

GGUF

Model size

7.62B params

Architecture

qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API

Unable to determine this model's library. Check the docs .