CoolFace
Datasetpublic

Corpus-NZ/High-Quality-Code

High-Quality-Code: Synthetic + Real (MAXIMUM CODE) A massive, high-quality code dataset built with maximum code philosophy – as much code as possible. Components Synthetic syntax-correction dataset – 5M+ examples across 33 languages (original code_syntax_dataset_1GB.csv) Real high-quality code from GitHub – 500 top-starred repositories – BOTH zips and extracted source Current Status: IN PROGRESS Target: 500 repos Currently uploaded: 12 extracted… See the full description on the dataset page: https://huggingface.co/datasets/Corpus-NZ/High-Quality-Code.

sourceHugging Faceotherupdated 12d agoView on Hugging Face
0likes1kdownloads
Dataset Card

High-Quality-Code: Synthetic + Real (MAXIMUM CODE)

A massive, high-quality code dataset built with maximum code philosophy – as much code as possible.

Components

  1. 1.Synthetic syntax-correction dataset – 5M+ examples across 33 languages (original code_syntax_dataset_1GB.csv)
  2. 2.Real high-quality code from GitHub – 500 top-starred repositories – BOTH zips and extracted source

Current Status: IN PROGRESS

  • —Target: 500 repos
  • —Currently uploaded: 12 extracted repos in github_code/ + 6 zips in github_code_zips/
  • —Upload method: Direct commit to main, zip version (main→master fallback), no size limit, temp files deleted after upload
  • —Process: Running in background – final-max-code-uploader

This README will be updated again when 500 is reached.

Structure (Maximum Code)

.
├── code_syntax_dataset_1GB.csv  # Synthetic: wrong_code, correct_code, explanation, language
├── github_code/                 # Real: Extracted source – MAX CODE
│   ├── owner__repo/
│   └── ...
├── github_code_zips/            # Real: Original zips – MAX PRESERVATION
│   ├── owner__repo.zip
│   └── ...
└── README.md
  • —github_code/ – extracted source code for training (all files, no filtering)
  • —github_code_zips/ – original zip archives for reproducibility

Both are uploaded for maximum code.

Top 500 Source

Fetched via GitHub API: stars:>5000 sort:stars desc – 500 most-starred repos.

First 50:

  • —codecrafters-io/build-your-own-x
  • —sindresorhus/awesome
  • —public-apis/public-apis
  • —freeCodeCamp/freeCodeCamp
  • —EbookFoundation/free-programming-books
  • —openclaw/openclaw
  • —donnemartin/system-design-primer
  • —nilbuild/developer-roadmap
  • —jwasham/coding-interview-university
  • —vinta/awesome-python
  • —awesome-selfhosted/awesome-selfhosted
  • —obra/superpowers
  • —practical-tutorials/project-based-learning
  • —996icu/996.ICU
  • —mattpocock/skills
  • —affaan-m/ECC
  • —react/react
  • —torvalds/linux
  • —NousResearch/hermes-agent
  • —trimstray/the-book-of-secret-knowledge
  • —TheAlgorithms/Python
  • —deepseek-ai/deepseek-harness
  • —vuejs/vue
  • —multica-ai/andrej-karpathy-skills
  • —ossu/computer-science
  • —anomalyco/opencode
  • —n8n-io/n8n
  • —tensorflow/tensorflow
  • —DigitalPlatDev/FreeDomain
  • —trekhleb/javascript-algorithms
  • —ultraworkers/claw-code
  • —microsoft/vscode
  • —yt-dlp/yt-dlp
  • —massgravel/Microsoft-Activation-Scripts
  • —ohmyzsh/ohmyzsh
  • —Significant-Gravitas/AutoGPT
  • —jackfrued/Python-100-Days
  • —CyC2018/CS-Notes
  • —getify/You-Dont-Know-JS
  • —avelino/awesome-go
  • —microsoft/markitdown
  • —ollama/ollama
  • —flutter/flutter
  • —firecrawl/firecrawl
  • —github/gitignore
  • —521xueweihan/HelloGitHub
  • —anthropics/skills
  • —twbs/bootstrap
  • —f/prompts.chat
  • —huggingface/transformers

... and 450 more.

How It Was Built (Maximum Code Philosophy)

python
# For each repo in top 500:
# 1. Try main.zip, then master.zip, plus codeload URLs
# 2. NO SIZE LIMIT – even torvalds/linux, freeCodeCamp, etc.
# 3. Upload zip to github_code_zips/owner__repo.zip (direct commit)
# 4. Extract zip, upload folder to github_code/owner__repo/ (direct commit)
# 5. Delete local temp immediately – nothing kept locally
# 6. Repeat until 500

Use Cases

  • —Pre-training LLMs on massive real code
  • —Fine-tuning for code correction (synthetic)
  • —Code generation, completion, understanding
  • —Maximum code = maximum learning

Licenses

  • —Synthetic CSV: ODA-TL v1.0
  • —Real GitHub code: Respective original licenses (check each repo's LICENSE)
  • —Use responsibly.

Links

  • —Dataset: https://huggingface.co/datasets/Corpus-NZ/High-Quality-Code
  • —In progress – final README will have full stats at 500 repos.

Built by Corpus-NZ – maximum code, direct commits, no local storage.

Corpus-NZ/High-Quality-Code · CoolFace