marianna13/llava-phi-2-3b-GGUF

Model Card for LLaVa-Phi-2-3B-GGUF

<!-- Provide a quick summary of what the model is/does. -->

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

Quantized version of llava-phi-2-3b. Quantization was done using llama.cpp

• —Developed by: LAION, SkunkworksAI & Ontocord
• —Model type: LLaVA is an open-source chatbot trained by fine-tuning Phi-2 on GPT-generated multimodal instruction-following data. It is an auto-regressive language model, based on the transformer architecture
• —Finetuned from model: Phi-2
• —License: MIT

Model Sources

<!-- Provide the basic links for the model. -->

• —Repository: BakLLaVa
• —LLama.cpp: GitHub

Usage

make & ./llava-cli -m ../ggml-model-f16.gguf --mmproj ../mmproj-model-f16.gguf --image /path/to/image.jpg

Evaluation

<!-- This section describes the evaluation protocols and provides the results. -->

Benchmarks

Image Captioning (MS COCO)