CoolFace
Apppublic

Krish-05/lightweight_chatbot

sourceHugging Facemitupdated 1y agoView on Hugging Face
0likes
App README

๐Ÿค– Ollama AI Assistant

This project hosts a lightweight AI assistant powered by Ollama, FastAPI, and Streamlit, all bundled in a single Docker environment.

๐Ÿš€ Overview

  • โ€”Ollama โ€“ Runs and serves the LLM model.
  • โ€”FastAPI โ€“ Handles backend API requests to interact with the model.
  • โ€”Streamlit โ€“ Provides a user-friendly web UI.
  • โ€”Docker โ€“ Runs everything in isolated and reproducible containers.

๐Ÿง  How It Works

  1. 1.Ollama loads the LLM model: krishna_choudhary/lightweight_chatbot.
  2. 2.FastAPI provides an API backend (running on internal port 7860) for prompt-response communication.
  3. 3.Streamlit UI (exposed on port 8501) lets users enter prompts and receive responses.
  4. 4.The UI interacts with FastAPI, which in turn queries the LLM via Ollama.

๐Ÿ–ฅ๏ธ User Interface

By default, the Streamlit UI is the primary interface and launches at: