Krish-05/lightweight_chatbot
0
๐ค Ollama AI Assistant
This project hosts a lightweight AI assistant powered by Ollama, FastAPI, and Streamlit, all bundled in a single Docker environment.
๐ Overview
- Ollama โ Runs and serves the LLM model.
- FastAPI โ Handles backend API requests to interact with the model.
- Streamlit โ Provides a user-friendly web UI.
- Docker โ Runs everything in isolated and reproducible containers.
๐ง How It Works
- Ollama loads the LLM model:
krishna_choudhary/lightweight_chatbot. - FastAPI provides an API backend (running on internal port
7860) for prompt-response communication. - Streamlit UI (exposed on port
8501) lets users enter prompts and receive responses. - The UI interacts with FastAPI, which in turn queries the LLM via Ollama.
๐ฅ๏ธ User Interface
By default, the Streamlit UI is the primary interface and launches at:
