128b
Datasets
All datasets matching “128b”ourmethod_128batchsize_continue_continue_continue_checkpointsiteboshi.logmel.128binsourmethod_128batchsize_continue_continue_checkpointscrisp-128b
Crisp-128B 🧼
A crisp, aggressively-cleaned 128-billion-token English pretraining corpus — pre-tokenized (GPT-2 BPE), document-aware, and nested-sampleable: take the first N tokens for any budget and you get a faithful mini-version of the whole thing.
Built for training language models from ~0.3B to ~3B parameters (1× to 50× Chinchilla) without touching a data pipeline. Just memmap and train.
Why this exists
Most open pretraining corpora make you choose: download… See the full description on the dataset page: https://huggingface.co/datasets/juliannunezb/crisp-128b.africa-drc-eaux-de-surface-detectees-par-satellite-entre-le-24-novemb-128b0b72
Eaux de surface détectées par satellite entre le 24 novembre et le 05 décembre 2022 dans la province de Tshopo, République Démocratique du Congo | Africa (DRC official open data)
74 rows - 1 Africa country - 2019-2022 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official XLSX resource from DRC as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-drc-eaux-de-surface-detectees-par-satellite-entre-le-24-novemb-128b0b72.poison_tr_0.1_128b