EB-Sky/python-domain-10gb
EB-Sky Python Domain (10GB) ~10GB of raw Python domain knowledge for continued pretraining: ~8GB of source code plus Stack Overflow Python Q&A. (2.49GB as stored — zstd-compressed parquet shards.) Sources Code: codeparrot/codeparrot-clean Q&A: koutch/stackoverflow_python Processing Size filter (200–200,000 chars per document) Auto-generated file removal (header heuristics) Hardcoded-secret regex scan, email redaction Exact deduplication (SHA-1)… See the full description on the dataset page: https://huggingface.co/datasets/EB-Sky/python-domain-10gb.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face