pacman
Datasets
All datasets matching “pacman”Puro-2B
Puro-2B Pretraining Data: The Recipe Behind a 2B Model
This is the materialized pretraining data release for
Puro-2B-Base, a 2B base model
trained from scratch on consumer-grade RTX 5090 GPUs.
The repository contains the component-level data pools used to construct the
two Puro-2B pretraining phases, together with the tokenizer used for token
accounting. It is organized for inspection, selective streaming, and recipe
reconstruction rather than as a small train/test… See the full description on the dataset page: https://huggingface.co/datasets/thu-pacman/Puro-2B.PCMind-2.1-Kaiyuan-2B
This repository contains the complete pretraining dataset for
PCMind-v2.1-Kaiyuan-2B, a leading fully open-source language model.
Overview
The dataset is organized into 5 training phases, with all phase datasets open-sourced in this repository. Our training methodology employs domain-specific mixing strategies across five primary domains:
English: General English text
Chinese: General Chinese text
Code: Programming and code-related content
Math: Mathematical reasoning and… See the full description on the dataset page: https://huggingface.co/datasets/thu-pacman/PCMind-2.1-Kaiyuan-2B.PacmanDataset_3PacmanDataset_Redis_Trypacman_dataset_gamengen_1pacman