Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Model

llava-llama-3-8b-v1_1-hf is a LLaVA model fine-tuned from meta-llama/Meta-Llama-3-8B-Instruct and [CLIP-ViT-Large-patch14-336]

coco dataset for visual finetune(LoRA-deepspeed): https://github.com/InternLM/xtuner/tree/main/xtuner/configs/llava/llama3_8b_instruct_clip_vit_large_p14_336 wget http://images.cocodataset.org/annotations/annotations_trainval2017.zip

we also upload robollava.gguf for using in other platforms(Ollama Xtuner etc.) #The process of model fine-tuning is shown in the following link https://www.guyuehome.com/ (waiting to update)

RoboLLaVA agent/project

https://github.com/conquererYang/RoboLLaVa

Downloads last month
2
Safetensors
Model size
8.35B params
Tensor type
FP16
·
Inference API
Unable to determine this model's library. Check the docs .