hreyulog/arkts-code-docstring

Recommended Version: ArkTS-CodeSearch-Pro

We strongly recommend using [ArkTS-CodeSearch-Pro](https://huggingface.co/datasets/hreyulog/arkts-code-docstring-pro) for all new research and development. The Pro version is the actively maintained release and provides improved data quality through stricter open-source license filtering, repository quality control (`stars > 0`), comment normalization, removal of license/copyright headers and code-only comments, minimum docstring length filtering, and global code/query deduplication.

The original ArkTS-CodeSearch dataset is preserved only for backward compatibility and reproducing results from previous versions. New experiments should use ArkTS-CodeSearch-Pro instead.

Paper | Evaluation Code |Dataset processing Code | Fine-Tuned Model | Repository-Level Split |

This dataset collects function-level information from ArkTS (HarmonyOS Ark TypeScript) projects, including original functions, docstrings, abstract syntax tree (AST) representations, obfuscated versions, and source code metadata. It is suitable for tasks such as code analysis, code understanding, AST research, and code search.

ArkTS is a core programming language in the OpenHarmony ecosystem. This dataset was constructed from open-source repositories crawled from GitHub and Gitee, targeting code retrieval and code evaluation tasks.

Note: ⚠️ Not Enterprise-Ready: This dataset is designed for research only. Some of the collected code may come from repositories without an explicit open-source license. Users should be aware that usage of such code may be subject to copyright restrictions.

Dataset Structure

The dataset contains three splits:

• —train: Training set
• —validation: Validation set
• —test: Test set

Each split is a JSON Lines (.jsonl) file, where each line is a JSON object representing a single function.

Features / Columns

Usage

from datasets import load_dataset

# Load the dataset
dataset = load_dataset("hreyulog/arkts-code-docstring")

# Inspect the first training example
print(dataset["train"][0])

# Check dataset features
print(dataset["train"].features)

Repo License Configuration

Contains repository license information from two sources:

• —github: reposlicensegithub.jsonl
• —gitee: reposlicensegitee.jsonl

Each line is a JSON object with repository metadata including source platform, repository name, license type, and URL.

Citation

If you use this dataset in your research, please cite the following paper:

@misc{he2026arktscodesearchopensourcearktsdataset,
      title={ArkTS-CodeSearch: A Open-Source ArkTS Dataset for Code Retrieval}, 
      author={Yulong He and Artem Ermakov and Sergey Kovalchuk and Artem Aliev and Dmitry Shalymov},
      year={2026},
      eprint={2602.05550},
      archivePrefix={arXiv},
      primaryClass={cs.SE},
      url={https://arxiv.org/abs/2602.05550}, 
}