datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Westminster-Planning-Decisions-2025
Westminster Planning Decisions 2025 — Officer Reasoning & Policy Citations
A structured sample of 50 planning decision records from Westminster City Council (January–November 2025), extracted from official Decision Notices and Delegated Reports into 37 fields. Built for planning consultants, appeal specialists, BTR/development risk teams, and academics who need to query officer reasoning, refusal grounds, and policy citations across applications — fields that exist as free text in… See the full description on the dataset page: https://huggingface.co/datasets/strictschema/Westminster-Planning-Decisions-2025.cc100-nepali-strictly-cleaned-devanagari-only
CC-100 Nepali — Cleaned(Devanagari Only)
Pipeline
Unicode normalisation (NFC + ftfy)
Rule-based filters (length, Devanagari ratio ≥ 0.5, boilerplate)
Language ID — fastText lid.176.bin, confidence ≥ 0.7
Exact deduplication (MD5)
Near-deduplication (char 13-gram bloom filter)
98/1/1 train/val/test split, seed 42
Usage
from datasets import load_dataset
ds = load_dataset("Basanta55/cc100-nepali-strictly-cleaned-devanagari-only")