EssentialAI/eai-taxonomy-stem-w-dclm
🔬 EAI-Taxonomy STEM w/ DCLM 🏆 Website | 🖥️ Code | 📖 Paper A high-quality STEM dataset curated from web data using taxonomy-based filtering, containing 1742 billion tokens of science, technology, engineering, and mathematics content. 🎯 Dataset Overview This dataset is part of the Essential-Web project, which introduces a new paradigm for dataset curation using expressive metadata and simple semantic filters. Unlike traditional STEM datasets that require… See the full description on the dataset page: https://huggingface.co/datasets/EssentialAI/eai-taxonomy-stem-w-dclm.
Update README.md
Update README.md
Update README.md
Update README.md
Create README.md
Upload using PySpark (part 00095-of-00096)
Upload using PySpark (part 00094-of-00096)
Upload using PySpark (part 00093-of-00096)
Upload using PySpark (part 00092-of-00096)
Upload using PySpark (part 00091-of-00096)
Upload using PySpark (part 00090-of-00096)
Upload using PySpark (part 00089-of-00096)
Upload using PySpark (part 00088-of-00096)
Upload using PySpark (part 00087-of-00096)
Upload using PySpark (part 00086-of-00096)
Upload using PySpark (part 00085-of-00096)
Upload using PySpark (part 00084-of-00096)
Upload using PySpark (part 00083-of-00096)
Upload using PySpark (part 00082-of-00096)
Upload using PySpark (part 00081-of-00096)
Upload using PySpark (part 00080-of-00096)
Upload using PySpark (part 00079-of-00096)
Upload using PySpark (part 00078-of-00096)
Upload using PySpark (part 00077-of-00096)
Upload using PySpark (part 00076-of-00096)
Upload using PySpark (part 00075-of-00096)
Upload using PySpark (part 00074-of-00096)
Upload using PySpark (part 00073-of-00096)
Upload using PySpark (part 00072-of-00096)
Upload using PySpark (part 00071-of-00096)
Upload using PySpark (part 00070-of-00096)
Upload using PySpark (part 00069-of-00096)
Upload using PySpark (part 00068-of-00096)
Upload using PySpark (part 00067-of-00096)
Upload using PySpark (part 00066-of-00096)
Upload using PySpark (part 00065-of-00096)
Upload using PySpark (part 00064-of-00096)
Upload using PySpark (part 00063-of-00096)
Upload using PySpark (part 00062-of-00096)
Upload using PySpark (part 00061-of-00096)
Upload using PySpark (part 00060-of-00096)
Upload using PySpark (part 00059-of-00096)
Upload using PySpark (part 00058-of-00096)
Upload using PySpark (part 00057-of-00096)
Upload using PySpark (part 00056-of-00096)
Upload using PySpark (part 00055-of-00096)
Upload using PySpark (part 00054-of-00096)
Upload using PySpark (part 00053-of-00096)
Upload using PySpark (part 00052-of-00096)
Upload using PySpark (part 00051-of-00096)