theothertom/codeparrot-python-only

🐍 CodeParrot Python Only

This dataset contains Python-only source code extracted from the larger CodeParrot corpus. It includes high-quality .py files filtered from public GitHub repositories and curated for use in training large language models (LLMs) on Python code generation tasks.

📦 Dataset Summary

• —✅ Filtered to include only Python code
• —🧹 Cleaned to remove non-source content (e.g., binaries, notebooks, scripts with mixed languages)
• —🧠 Ideal for training or evaluating code generation models
• —🧾 Each entry is a code snippet or full Python file stored as raw text

💡 Use Cases

This dataset is best suited for:

• —Training/fine-tuning LLMs for:
• —Python code generation
• —Auto-completion
• —Bug detection
• —Code summarization
• —Evaluating code-specific capabilities of general LLMs
• —Research in code intelligence, representation learning, and software engineering

📁 Example Format

Each record is a single code block:

{
  "code": "def hello_world():\n    print('Hello, world!')"
}

🚀 How to Use

from datasets import load_dataset

ds = load_dataset("theothertom/codeparrot-python-only")
print(ds["train"][0]["code"])