epazar2020/epazar-llm

Toy Model Chat

A simple chat interface for a custom transformer language model built from scratch.

Features

• —Custom transformer model implementation
• —GPT-2 tokenizer integration
• —Simple chat interface
• —Real-time text generation

Usage

Just type your message and press Send to chat with the model!

Model

The model is a small transformer with:

• —12 embedding dimensions
• —4 attention heads
• —8 layers
• —32 context length

Requirements

• —gradio==4.44.0
• —torch>=2.7.1
• —tiktoken==0.8.0
• —transformers>=4.0.0