LocalWisdom/PurpleGloVe

PurpleGloVe

Simple implementation of GloVe using PyTorch and modern (2026) HuggingFace devkit such as Datasets, Tokenizers, and Safetensors. This repository is suitable for any beginners trying to understand how to incorporate HuggingFace into their workflow with PyTorch.

We will be demonstrating the use of saved tokenizer and config by calling the from_pretrained method of a model or a tokenizer class. A very first-principled use of HF devkit made easy to understand.

Usage

uv run app.py

See train.ipynb for training recipe.

Notes on Variable Misnaming

I initially written Wi, Wj, Bi, and Bj like so. But in the paper, Wj and Bj is actually also subscript i but with tidle above W and B to denote the context word vector.

The app.py script already has a note for this, the script works just fine.