Datasetpublic

opendatalab/SlimPajama-Meta-rater-Professionalism-30B

Top 30B token SlimPajama Subset selected by the Professionalism rater This repository contains the dataset described in the paper Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Models. Code: https://github.com/opendatalab/Meta-rater Dataset Description This dataset contains the top 30B tokens from the SlimPajama-627B corpus, selected using the Professionalism dimension of the PRRC (Professionalism, Readability, Reasoning… See the full description on the dataset page: https://huggingface.co/datasets/opendatalab/SlimPajama-Meta-rater-Professionalism-30B.

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes190downloads

settings

This repository belongs to opendatalab on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameSlimPajama-Meta-rater-Professionalism-30B

visibilitypublic

licencenot set

gatedno

owneropendatalab

Account settings