datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
function-calling-chatml
Dataset Card for "function-calling-chatml"
Converted glaiveai/Glaive-function-calling-v2 to chatml format.
Example entry
[ { "from": "system", "value": "You are a helpful assistant with access to the following functions. Use them if required -{\n \"name\": \"create_contact\",\n \"description\": \"Create a new contact\",\n \"parameters\": {\n \"type\": \"object\",\n \"properties\": {\n \"name\": {\n \"type\": \"string\",\n \"description\": \"The name of the contact\"\n }… See the full description on the dataset page: https://huggingface.co/datasets/Locutusque/function-calling-chatml.ultrachat-10k-chatmldolly-chatml-sftmitre-stix-cve-exploitdb-dataset-alpaca-chatml-harmony
MITRE+NVD+ExploitDB Dataset (Alpaca/ChatML/Harmony)
A dataset for training AI assistants/agents on vulnerability analysis and pentesting Q&A. It is built by the pentestds pipeline, which fetches and merges data from MITRE CVE, NVD (CVSS enrichment), ExploitDB, and a small set of HuggingFace datasets. Provenance is recorded for every entry, and the pipeline emits Alpaca, ChatML, and Harmony JSONL files.
Dataset Summary
This dataset is designed for training AI agents to… See the full description on the dataset page: https://huggingface.co/datasets/jason-oneal/mitre-stix-cve-exploitdb-dataset-alpaca-chatml-harmony.llm-jp-4-thinking-sft-data-chatmlllm-jpのデータセットllm-jp-4-thinking-sft-dataを、
ChatML形式に変換したものです。
ライセンス
各サンプルのライセンスは、元データセットカードに記載された各データソースのライセンスに従います。
本リポジトリは、元となったデータ全体に対して新たなライセンスを付与するものではありません。
利用する場合は、対応する元データソースのライセンス条件を確認してください。
Tiny-Short-R1-CoT-Distill-HF-ChatMLOnly Short CoT
Type: 'tiny' (Very Small CoT)
Type: 'short' (Small CoT)
Each CoT Should be less than 2048 tokens
Subset of glaiveai/reasoning-v1-20m
chatml-2026-0416unified-uncensored-qwen-chatml-sft
Unified Uncensored Qwen SFT Dataset
This dataset is a mixed-license compilation of instruction/chat datasets converted into a single Qwen/ChatML-style text JSONL format.
Format
Each row has:
{
"text": "<|im_start|>user\n...<|im_end|>\n<|im_start|>assistant\n...<|im_end|>",
"source": "dataset/repo",
"source_format": "alpaca|sharegpt|messages|human_bot_text|prompt_response",
"source_license": "apache-2.0|mit|cc-by-4.0|cc-by-nc-4.0|other|unknown",
"source_family":… See the full description on the dataset page: https://huggingface.co/datasets/usamakenway/unified-uncensored-qwen-chatml-sft.tldr-17-ChatMLgpt-roleplay-realm-chatml
Follow me
HuggingFace: https://huggingface.co/AlekseyKorshuk
GitHub: https://github.com/AlekseyKorshuk
Twitter / X: https://x.com/alekseykorshuk
dailydialog-chatmlpentest-agent-dataset-chatml
Pentest Agent Dataset - ChatML
This dataset is part of the Pentest Agent project and contains cybersecurity data formatted for fine-tuning language models.
Data Sources
Based on real CVEs from MITRE/NVD
Enriched with CVSS impact metrics
Linked to exploit code when available
Includes real-world pentesting scenarios
Contains command logic and execution steps
Includes red team techniques with MITRE references
Generated in ChatML format
Structure
Each sample… See the full description on the dataset page: https://huggingface.co/datasets/7h3-R3v3n4n7/pentest-agent-dataset-chatml.midas_stage4_sft_chatmlKVQA-ChatML
KVQA-ChatML Dataset
이 데이터셋은 SKT의 KVQA 데이터셋을 ChatML 형식으로 변환한 것입니다.
데이터셋 정보
원본 데이터셋: skt/KVQA
총 샘플 수: 약 100,000개
파일 수: 100개 parquet 파일
포맷: ChatML (user/assistant 대화 형식)
데이터 구조
{
"image": PIL.Image,
"conversations": [
{"role": "user", "content": "질문"},
{"role": "assistant", "content": "답변"}
],
"id": "unique_id",
"source": "KVQA",
"answer_type": "answer_type",
"answerable": boolean
}
사용 방법
from datasets… See the full description on the dataset page: https://huggingface.co/datasets/ko-vlm/KVQA-ChatML.medical-sci-instruct-100k-sharegpt-chatmlThis is a reformat of the database formatted for Mistral training with chatml tokens added to the tokenizer, and '<|endoftext|>' as an end of sequence token.
The max_length setting may need to be adjusted to include the additional tokens for training.
This max_length was set to 2030 from 2048 for extra headroom.
keural-SFT-chatml-ko-v1
Keural SFT ChatML (Korean) v1
한국어 SFT(Supervised Fine-Tuning)용 통합 데이터셋입니다. 공개 한국어 instruction/대화 데이터셋 8종을 수집하여 정제 → 품질 필터링 → 안전성 필터링 → 중복 제거(exact + MinHash near-dup) → ChatML 포맷팅 → 토크나이즈 검증을 거친 결과물입니다.
총 샘플 수: 710,278
총 토큰 수: 약 1.9억 (190,724,939 tokens, keural tokenizer 기준)
포맷: ChatML (<|im_start|>role ... <|im_end|>)
최대 길이: 8,192 tokens (초과 시 truncate)
생성일: 2026-07-10
데이터 구조
각 샤드는 JSONL 형식이며, 레코드 스키마는 다음과 같습니다:
{"text":… See the full description on the dataset page: https://huggingface.co/datasets/mkd-jueon/keural-SFT-chatml-ko-v1.chatml-synthetic-2026-0420i1_chatmliv4-chatml-4k
Dataset Card for "iv4-chatml-4k"
More Information needed
cybersec-chatml-vuln-patch-v1
Cybersecurity ChatML SFT Dataset (Detection + Patch + Multitask)
This dataset contains ChatML records for 2 security tasks:
Vulnerability detection (is_vulnerable, cwe, severity JSON output)
Secure patch generation (assistant returns patched code only)
Files
chatml_detection_train.jsonl
chatml_detection_val.jsonl
chatml_patch_train.jsonl
chatml_patch_val.jsonl
chatml_multitask_train.jsonl
chatml_multitask_val.jsonl
chatml_build_manifest.json… See the full description on the dataset page: https://huggingface.co/datasets/Kushalkhemka/cybersec-chatml-vuln-patch-v1.mlabonne-chatml-dpo-pairs-copyThis is a copy and unmaintained version of mlabonne/chatml_dpo_pairs that we use in TRL CI for testing purpose. Please refer to the original dataset for usage and more details
OpenOrca-Traditional-Chinese-ChatML-Formatglaive-function-calling-v2-chatmlVietnamese-Locutusque-function-calling-chatml-gg-translatednemotron-sft-general-focused-stage1-2-ChatML-V3
Nemotron SFT Dataset (Chat Template Formatted)
Overview
This dataset is a curated supervised fine-tuning (SFT) dataset built from NVIDIA's Nemotron-Cascade-SFT-Stage-1 and Stage-2 datasets.
Important: This dataset uses the tokenizer's apply_chat_template() method to properly format conversations from the original messages/conversations fields.
Statistics
Total Samples: 496,385
Total Tokens: 1,114,218,401
Average Tokens per Sample: 2244.7
Tokenizer:… See the full description on the dataset page: https://huggingface.co/datasets/kshitijthakkar/nemotron-sft-general-focused-stage1-2-ChatML-V3.details_anthracite-org__magnum-v3-9b-chatml
Dataset Card for Evaluation run of anthracite-org/magnum-v3-9b-chatml
Dataset automatically created during the evaluation run of model anthracite-org/magnum-v3-9b-chatml.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_anthracite-org__magnum-v3-9b-chatml.chatml-critique-2026-0420Java_method2test_chatml
Java Method to Test ChatML
This dataset is based on the methods2test dataset from Microsoft. It follows the ChatML template format: [{'role': '', 'content': ''}, {...}].
Originally, methods2test contains only Java methods at different levels of granularity along with their corresponding test cases. The different focal method segmentations are illustrated here:
To simulate a conversation between a Java developer and an AI assistant, I introduce two key parameters:
The prompt… See the full description on the dataset page: https://huggingface.co/datasets/random-long-int/Java_method2test_chatml.synthetic-dialog-summaries-processed-clean-chatmlsharegpt-chatml
Dataset Card for "sharegpt-chatml"
Data preprocessing pipeline: https://github.com/AlekseyKorshuk/chat-data-pipeline