|
--- |
|
language: |
|
- en |
|
license: apache-2.0 |
|
tags: |
|
- llava |
|
- multimodal |
|
- phi-mini-3 |
|
- mlx |
|
--- |
|
|
|
# mlx-community/llava-phi-3-mini-4bit |
|
This model was converted to MLX format from [`qnguyen3/nanoLLaVAxtuner/llava-phi-3-mini-hf`]() using mlx-vllm version **0.0.3**. |
|
Refer to the [original model card](xtuner/llava-phi-3-mini-hf) for more details on the model. |
|
## Use with mlx |
|
|
|
```bash |
|
pip install -U mlx-vlm |
|
``` |
|
|
|
```bash |
|
python -m mlx_vlm.generate --model mlx-community/llava-phi-3-mini-4bit \ |
|
--prompt "what are these?" --image "http://images.cocodataset.org/val2017/000000039769.jpg" \ |
|
--max-tokens 100 --temp 0.0 |
|
``` |
|
|
