Datasetpublic

Research-EAI/essential-web-1t-sample-fdc-partitioned

🌐 Essential-Web: FDC Level-2 Partitioned Dataset 📋 Dataset Description This dataset contains a 1 trillion token sample from Essential-Web, partitioned by Free Decimal Correspondence (FDC) level-2 categories. Essential-Web is a 24-trillion-token web dataset with extensive document-level metadata designed to enable rapid dataset curation through SQL-like filtering. 🔍 Free Decimal Correspondence (FDC) The FDC taxonomy is an open classification… See the full description on the dataset page: https://huggingface.co/datasets/Research-EAI/essential-web-1t-sample-fdc-partitioned.

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

5likes11kdownloads

50 commits on main

206e3451y ago

Update README.md

Research-EAI

489d4ef1y ago

Update README.md

Research-EAI

4a628681y ago

Update README.md

Research-EAI

51ee90e1y ago

Update README.md

Research-EAI

9ffa78e1y ago

Update README.md

Research-EAI

28298f21y ago

Update README.md

Research-EAI

6f419c31y ago

Update README.md

Research-EAI

ec58b951y ago

Update README.md

Research-EAI

fa04b981y ago

Upload using PySpark (part 00002-of-00003)

Research-EAI

9df4a641y ago

Upload using PySpark (part 00001-of-00003)

Research-EAI

1e76daf1y ago

Upload using PySpark (part 00000-of-00003)

Research-EAI

d6b0fb21y ago

Upload using PySpark

Research-EAI

b5339571y ago

Upload using PySpark (part 00001-of-00002)

Research-EAI

f27cfaa1y ago

Upload using PySpark (part 00000-of-00002)

Research-EAI

e66a43b1y ago

Upload using PySpark (part 00001-of-00002)

Research-EAI

8f7d21f1y ago

Upload using PySpark (part 00000-of-00002)

Research-EAI

b04159b1y ago

Upload using PySpark

Research-EAI

ff3fced1y ago

Upload using PySpark (part 00001-of-00002)

Research-EAI

0523f351y ago

Upload using PySpark (part 00000-of-00002)

Research-EAI

b81ce231y ago

Upload using PySpark (part 00001-of-00002)

Research-EAI

9b63a201y ago

Upload using PySpark (part 00000-of-00002)

Research-EAI

8e585831y ago

Upload using PySpark

Research-EAI

453c1cc1y ago

Upload using PySpark

Research-EAI

e21f3d01y ago

Upload using PySpark

Research-EAI

e1f003e1y ago

Upload using PySpark

Research-EAI

463e4e41y ago

Upload using PySpark

Research-EAI

13fa3231y ago

Upload using PySpark

Research-EAI

78335b51y ago

Upload using PySpark (part 00001-of-00002)

Research-EAI

028d8f81y ago

Upload using PySpark (part 00000-of-00002)

Research-EAI

24f86e61y ago

Upload using PySpark

Research-EAI

16bfb3e1y ago

Upload using PySpark

Research-EAI

8d01ba01y ago

Upload using PySpark (part 00004-of-00005)

Research-EAI

3ee80711y ago

Upload using PySpark (part 00003-of-00005)

Research-EAI

e5a615d1y ago

Upload using PySpark (part 00002-of-00005)

Research-EAI

6f1d0dd1y ago

Upload using PySpark (part 00001-of-00005)

Research-EAI

1c099041y ago

Upload using PySpark (part 00000-of-00005)

Research-EAI

1edd7301y ago

Upload using PySpark (part 00007-of-00008)

Research-EAI

2b06b6f1y ago

Upload using PySpark (part 00006-of-00008)

Research-EAI

85a06b91y ago

Upload using PySpark (part 00005-of-00008)

Research-EAI

baf35211y ago

Upload using PySpark (part 00004-of-00008)

Research-EAI

02093291y ago

Upload using PySpark (part 00003-of-00008)

Research-EAI

2a80ea01y ago

Upload using PySpark (part 00002-of-00008)

Research-EAI

5aa8c651y ago

Upload using PySpark (part 00001-of-00008)

Research-EAI

b7dc1201y ago

Upload using PySpark (part 00000-of-00008)

Research-EAI

601253d1y ago

Upload using PySpark (part 00010-of-00011)

Research-EAI

6b653761y ago

Upload using PySpark (part 00009-of-00011)

Research-EAI

6b500761y ago

Upload using PySpark (part 00008-of-00011)

Research-EAI

23d40821y ago

Upload using PySpark (part 00007-of-00011)

Research-EAI

0509e9b1y ago

Upload using PySpark (part 00006-of-00011)

Research-EAI

f8020591y ago

Upload using PySpark (part 00005-of-00011)

Research-EAI