EricB
/

Llama-3.2-11B-Vision-Instruct-UQFF

Model card Files Files and versions Community

EricB HF staff commited on Sep 30

Commit

79d23a3

•

1 Parent(s): fd5f074

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -21,5 +21,5 @@ Run with [mistral.rs](https://github.com/EricLBuehler/mistral.rs). Documentation
 |Name|Quantization type(s)|Example|
 |--|--|--|
-|llama-3.2-11b-vision-q4k.uqff|Q4K|`./mistralrs-server -i plain -m meta-llama/Llama-3.2-11B-Vision-Instruct --from-uqff EricB/Llama-3.2-11B-Vision-Instruct-UQFF/llama-3.2-11b-vision-q4k.uqff`|
-|llama-3.2-11b-vision-q8_0.uqff|Q8_0|`./mistralrs-server -i plain -m meta-llama/Llama-3.2-11B-Vision-Instruct --from-uqff EricB/Llama-3.2-11B-Vision-Instruct-UQFF/llama-3.2-11b-vision-q8_0.uqff`|

 |Name|Quantization type(s)|Example|
 |--|--|--|
+|llama-3.2-11b-vision-q4k.uqff|Q4K|`./mistralrs-server -i vision-plain -m meta-llama/Llama-3.2-11B-Vision-Instruct -a vllama --from-uqff EricB/Llama-3.2-11B-Vision-Instruct-UQFF/llama-3.2-11b-vision-q4k.uqff`|
+|llama-3.2-11b-vision-q8_0.uqff|Q8_0|`./mistralrs-server -i vision-plain -m meta-llama/Llama-3.2-11B-Vision-Instruct -a vllama --from-uqff EricB/Llama-3.2-11B-Vision-Instruct-UQFF/llama-3.2-11b-vision-q8_0.uqff`|