Datasetpublic

MiniLLM/pile-diff_samp-qwen_1.8B-qwen_104M-r0.5

This repository contains the refined pre-training corpus from the paper MiniPLM: Knowledge Distillation for Pre-Training Language Models. Code: https://github.com/thu-coai/MiniPLM

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes276downloads

discussions and pull requests

Conversations for this repository live on Hugging Face.

CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.

Open discussions on Hugging Face