CoolFace
Apppublic

Lual13012/rag-document-ChatBot-APP

sourceHugging Faceupdated 3mo agoView on Hugging Face
1likes
App README

๐Ÿ“‘ RAG Document Chatbot (RAG Application)

An offline-capable, interactive Retrieval-Augmented Generation (RAG) chatbot that allows you to upload any PDF document and ask questions about its content. This application uses LangChain for orchestration, Groq (Llama 3.3 70B) for ultra-fast inference, and local Hugging Face BGE Embeddings for precise document retrieval.


๐Ÿš€ Features

  • โ€”PDF Document Parsing: Upload any PDF to instantly split and index its pages.
  • โ€”In-Memory Vector Store: Uses Chroma DB natively without bloat to isolate document data seamlessly per session.
  • โ€”Local Embeddings: Generates vector embeddings locally using the highly efficient BAAI/bge-small-en-v1.5 model.
  • โ€”Llama 3.3 Intelligence: Leverages Groq Cloud API for near-instant, highly context-aware responses.
  • โ€”Guardrails: Built-in instructions prevent the LLM from making up answers if the information isn't found in the document.
  • โ€”Clean Session Management: Sidebar settings to wipe chat histories cleanly and switch documents effortlessly.

๐Ÿ› ๏ธ Tech Stack

  • โ€”Frontend UI: Streamlit
  • โ€”LLM Orchestration: LangChain / LangChain Core
  • โ€”Inference Engine: ChatGroq (Model: llama-3.3-70b-versatile)
  • โ€”Vector Database: Chroma
  • โ€”Text Embedding Model: Hugging Face Transformers (bge-small-en-v1.5)