AdityaNarayan/HyperSwitch-Repo-CPT-Dataset-v2

Hyperswitch Rust Codebase Dataset

A comprehensive dataset extracted from the Hyperswitch open-source payment processing platform, containing 16,731 code samples across 37 modules with 6.99M tokens for training Rust code understanding and generation models.

📊 Dataset Overview

This dataset provides both file-level and granular code samples from Hyperswitch, a modern payment switch written in Rust. It's designed for training code models to understand payment processing patterns, Rust idioms, and large-scale system architecture.

Key Statistics

• —Total Samples: 16,990

🏗️ Dataset Structure

Sample Distribution by Type

"total_samples": 16990,
  "file_level_samples": 3143,
  "granular_samples": 13847,
  "commit_samples": 0,
  "total_tokens": 8899898,
  "sample_types": {
    "impl_block": 4103,
    "function_signature": 3993,
    "struct_definition": 5484,
    "full_file": 1623,
    "doc_chunk": 69,
    "openapi_block": 709,
    "trait_definition": 221,
    "web_doc_file": 72,
    "doc_file": 238,
    "chunk": 432,
    "macro": 44,
    "impl_block_chunk": 2
  }

🙏 Acknowledgments

• —Hyperswitch Team for building an excellent open-source payment platform
• —Rust Community for creating robust tooling and documentation standards
• —Juspay Technologies for open-sourcing this valuable codebase

📞 Citation

@dataset{HyperSwitch-Repo-CPT-Dataset-v2,
  title={HyperSwitch-Repo-CPT-Dataset-v2},
  author={Aditya Narayan},
  year={2024},
  publisher={Hugging Face},
  url={https://huggingface.co/datasets/AdityaNarayan/HyperSwitch-Repo-CPT-Dataset-v2},
  note={Extracted from https://github.com/juspay/hyperswitch}
}

This dataset is part of ongoing research into domain-specific code model training for financial technology applications.