Datasetpublic

bhavnicksm/fineweb-edu-micro

FineWeb-Edu Micro This dataset is a subset of the FineWeb-Edu Sample-10BT, which contains passages that are at least 1000 tokens long, totalling about 1 Million tokens . This dataset was primarily made to evaluate different RAG Chunking mechanisms in Chonkie

sourceHugging Faceodc-byupdated 2y agoView on Hugging Face

0likes1.6kdownloads

Dataset Card

FineWeb-Edu Micro

This dataset is a subset of the FineWeb-Edu Sample-10BT, which contains passages that are at least 1000 tokens long, totalling about 1 Million tokens .

This dataset was primarily made to evaluate different RAG Chunking mechanisms in Chonkie