Faraz618/VisualRAG
0
๐ VisualRAG โ Multi-Modal AI System
A production-grade Retrieval-Augmented Generation (RAG) system combining computer vision and natural language understanding.
๐ง Pipeline
Index: Image โ YOLOv8 detection โ CLIP ViT-B/32 embedding โ FAISS vector store Query: Text โ CLIP text embedding โ cosine k-NN โ Zephyr-7B answer generation
๐ Stack
๐ How to use
- Detect & Index โ upload images; YOLOv8 detects objects, CLIP stores 512-d embeddings in FAISS
- Query (RAG) โ ask a question; CLIP retrieves relevant images, Zephyr-7B answers
- How it works โ full architecture overview
๐ Optional: HF token
Settings โ Variables and secrets โ New secret โ Name: HF_TOKEN
