Datasetpublic

ASTRAI-labs/Pluto-Nano-1.0-Pretrain-v2

ASTRAI Pluto Nano 1.0 — Pretrain Mix (v2) Curated multilingual pretraining corpus (~50 GB parquet, ~12 B tokens after tokenization) used for ASTRAI Pluto Nano 1.0, a 1 B-total / 50 M-active MoE model with 64 k vocabulary and 5 target languages (EN, PT, ES, ZH, HI). v2 additions vs v1: OpenThoughts3 (CoT reasoning), openstax textbooks + peS2o (science), and reweighting for better balance. NOTE: factsense (openbmb) was used at training time but is not redistributed here due to its… See the full description on the dataset page: https://huggingface.co/datasets/ASTRAI-labs/Pluto-Nano-1.0-Pretrain-v2.

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

2likes549downloads

settings

This repository belongs to ASTRAI-labs on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namePluto-Nano-1.0-Pretrain-v2

visibilitypublic

licenceapache-2.0

gatedno

ownerASTRAI-labs

Account settings