datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Athar-Shamela4
Shamela 4 — Full Islamic Library Corpus
A complete extraction of al-Maktaba al-Shamela (الشاملة) v4, containing 8,589 books across 40 categories of classical Islamic sciences. Extracted from the original Lucene + Sqlite Shamela DB on 2026-04-26 with ~7.6 million pages and ~19 GB of Arabic text.
Dataset Structure
stage0_raw/
├── _meta/ # Cross-cutting metadata (Parquet + JSONL)
│ ├── extraction_manifest.json # Global extraction record… See the full description on the dataset page: https://huggingface.co/datasets/Kandil7/Athar-Shamela4.knights-and-knaves
📘 knights-and-knaves Dataset [Project Page]
The knights-and-knaves dataset serves as a logical reasoning benchmark to evaluate the reasoning capabilities of LLMs.
🚀🚀 Check out the perturbed knights-and-knaves dataset to evaluate the memorization of LLMs in reasoning.
Loading the dataset
To load the dataset:
from datasets import load_dataset
data_subject = load_dataset('K-and-K/knights-and-knaves','test',split="2ppl")
Available subset: test, train.
Available… See the full description on the dataset page: https://huggingface.co/datasets/K-and-K/knights-and-knaves.kangaroo_dataset
German Kangaroo Benchmark
The complete German Mathematical Kangaroo archive from 1998 to 2025 as a
multiple-choice benchmark: 3,886 items from 140 exams in five grade groups
(3--4, 5--6, 7--8, 9--10, 11--13), worth 3, 4, or 5 points each. 1,746 items are
multimodal, with a question diagram, image-based answer options, or both. The
accompanying paper describes the extraction, the evaluation protocol, and the
results.
Files
kangaroo.parquet: the benchmark, 3,886… See the full description on the dataset page: https://huggingface.co/datasets/kangaroo-dataset-german/kangaroo_dataset.indian-legal-documents
Indian Legal Documents
Open Indian statutory and legal-document data for AI, search, and legal research.
This dataset is part of the KanoonGPT Open Legal Data Initiative — an effort to make Indian legal data easier to access, structure, and build on for open-source research, legal tech, and production AI systems.
KanoonGPT is building structured Indian legal datasets and data infrastructure for open-source, research, and enterprise AI applications. Learn more at kanoongpt.in.… See the full description on the dataset page: https://huggingface.co/datasets/KanoonGPT/indian-legal-documents.Agent-Reasoning-WebSearch-260K
Edge Agent Reasoning WebSearch 260K
Abstract
The Edge-Agent-Reasoning-WebSearch-260K dataset is a massive, synthetically expert-engineered corpus of over 700 Million tokens, designed to train small, local models (SLMs) and edge-deployed agents in advanced problem deconstruction and self-aware reasoning.
Rather than training a model to execute instructions directly—which often leads to hallucinations when context is missing—this dataset trains a model to act as a… See the full description on the dataset page: https://huggingface.co/datasets/kanepi-1977/Agent-Reasoning-WebSearch-260K.SHP
🚢 Stanford Human Preferences Dataset (SHP)
If you mention this dataset in a paper, please cite the paper: Understanding Dataset Difficulty with V-Usable Information (ICML 2022).
Summary
SHP is a dataset of 385K collective human preferences over responses to questions/instructions in 18 different subject areas, from cooking to legal advice.
The preferences are meant to reflect the helpfulness of one response over another, and are intended to be used for training… See the full description on the dataset page: https://huggingface.co/datasets/Kanika0110/SHP.Athar-Datasets
🕌 Athar Islamic QA Datasets
18.7M passages from classical Islamic books spanning 1,400 years of scholarship
A comprehensive collection of Islamic texts covering Quran, Hadith, Fiqh, Tafsir, Aqeedah, Seerah, and more — sourced from the Shamela library and enriched with scholarly metadata for RAG-based Islamic QA systems.
Based on the Fanar-Sadiq Architecture for grounded, citation-backed Islamic question answering.
📊 Dataset Summary
Metric
Value… See the full description on the dataset page: https://huggingface.co/datasets/Kandil7/Athar-Datasets.Athar-RAG-Hub
Athar RAG Hub 🕌
Collection
Chunks
seerah
5,852
perturbed-knights-and-knaves
📘 perturbed-knights-and-knaves Dataset [Project Page]
The perturbed-knights-and-knaves dataset evaluates the consistency of LLMs' logical reasoning ability under various perturbations.
🚀🚀 Check out the clean version of the dataset at [knights-and-knaves].
Loading the dataset
To load the dataset:
from datasets import load_dataset
data_subject = datasets.load_dataset('K-and-K/perturbed-knights-and-knaves', data_files="{subset}/{perturbation}/{subject}.jsonl")… See the full description on the dataset page: https://huggingface.co/datasets/K-and-K/perturbed-knights-and-knaves.ELAIPBench
ELAIPBench Dataset
Description
This dataset contains academic questions with evidence passages extracted from research papers. Each question is paired with a relevant passage from the source paper that provides evidence for answering the question.It was officially adopted as the dataset for the CCKS 2025 Academic Paper Question Answering Challenge.
Dataset Structure
The dataset contains 403 questions with the following fields:
paper_id: ID of the source paper… See the full description on the dataset page: https://huggingface.co/datasets/KangKang625/ELAIPBench.tibyan-quran-complete
Tibyan Quran Complete Dataset
Complete Quran dataset with 114 surahs and 6,236 ayahs in Uthmani Arabic script, with metadata and multiple text formats.
Data Fields
Field
Type
Description
surah_id
int
Surah number (1-114)
surah_name_ar
string
Arabic name of the surah
surah_name_en
string
English name of the surah
ayah_number
int
Verse number within surah
text_uthmani
string
Uthmani script (official)
text_simple
string
Simplified Arabic
juz
int
Juz… See the full description on the dataset page: https://huggingface.co/datasets/Kandil7/tibyan-quran-complete.Code-170k-kanuri
Dataset Description
Code-170k-kanuri is a groundbreaking dataset containing 176,999 programming conversations, originally sourced from glaiveai/glaive-code-assistant-v2 and translated into Kanuri, making coding education accessible to Kanuri speakers.
🌟 Key Features
176,999 high-quality conversations about programming and coding
Pure Kanuri language - democratizing coding education
Multi-turn dialogues covering various programming concepts
Diverse topics: algorithms… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/Code-170k-kanuri.KannadaPromptBench
KannadaPromptBench
A benchmark dataset for evaluating prompt strategy sensitivity in Kannada, a low-resource Dravidian language.
Dataset Summary
Language: Kannada (kn)
Tasks: Sentiment Analysis (100), Question Answering (75), Summarization (50)
Total: 225 culturally grounded samples
Inter-annotator agreement: Cohen's κ > 0.80
Dataset Structure
Each sample contains: id, task, input_text, label, difficulty, domain.
Citation
Please… See the full description on the dataset page: https://huggingface.co/datasets/Anushhh/KannadaPromptBench.ru-instruct-KAN-logic-v1
Russian Instruct KAN-Logic Dataset (v1)
Overview
ru-instruct-KAN-logic-v1 — это специализированный набор данных для instruction tuning (дообучения) языковых моделей на русском языке.
Основной фокус датасета — сложные логические рассуждения (Reasoning), математическое обоснование нейросетевых архитектур нового поколения (KAN - Kolmogorov-Arnold Networks) и теория распределенных вычислений.
Датасет содержит синтетические и курируемые пары instruction - output… See the full description on the dataset page: https://huggingface.co/datasets/K-Net-Labs/ru-instruct-KAN-logic-v1.nihongo-dojo-grades1-2-3-4-5-6-kanji_reading-kanji_writing
nihongo-dojo-grades1-2-3-4-5-6-kanji_reading-kanji_writing
このデータセットは、Nihongo DoJoフレームワークを使用して生成された日本語学習用データセットです。
データセット統計
train: 2,418 サンプル
validation: 302 サンプル
test: 303 サンプル
総サンプル数: 3,023
ソース
生成元: ./datasets/nihongo-dojo-grades1-2-3-4-5-6-kanji_reading-kanji_writing/
サンプルデータ
{
"instruction": "次の漢字の訓読み（くんよみ）をひらがなで答えてください。",
"input": "「究」の訓読みは？",
"think": "この漢字は「究」です。 小学3年生で習う漢字です。 意味は「research」などです。 訓読み（くんよみ）は日本語の読み方です。 この漢字の訓読みは「きわ」です。"… See the full description on the dataset page: https://huggingface.co/datasets/AkabekoLabs/nihongo-dojo-grades1-2-3-4-5-6-kanji_reading-kanji_writing.BCE-Prettybird-Nano-Kangal-v0.1
BCE-Prettybird-Nano-Kangal-v0.1 - 525 LOVE Q&A Dataset for Instruction-Based Learning
The "BCE-Prettybird-Nano-Kangal-v0.1: Love Dataset" consists of 525 rows of insightful data, offering a comprehensive exploration of romantic relationships. Covering diverse aspects from sexuality and intimacy to romance, family life management, and tips on how to treat women, this dataset delves into the complexities of modern relationships. It aims to provide valuable perspectives for those… See the full description on the dataset page: https://huggingface.co/datasets/pthinc/BCE-Prettybird-Nano-Kangal-v0.1.awesome_chatgpt_prompts_kannadaKannada translation of fka/awesome-chatgpt-prompts
AutoWikiQA
Wikipedia日本語版からのQ&Aの自動生成
Mixtral 8x22bのGGUF(5bit)をベースに､Wikipedia日本語版の記事から､
自動生成コード1
自動生成コード2
を使ってQ&Aを作成しました｡
計算には東京工業大学のスーパーコンピュータTSUBAME4.0を利用しました｡
注意
回答にハルシネーション等が含まれている可能性があるので､フィルタリングをかける必要があるかもしれません｡
nihongo-dojo-grades1-2-3-kanji_reading
nihongo-dojo-grades1-2-3-kanji_reading
このデータセットは、Nihongo DoJoフレームワークを使用して生成された日本語学習用データセットです。
データセット統計
train: 846 サンプル
validation: 105 サンプル
test: 107 サンプル
総サンプル数: 1,058
ソース
生成元: ./datasets/nihongo-dojo-grades1-2-3-kanji_reading/
サンプルデータ
{
"instruction": "次の漢字の音読み（おんよみ）をカタカナで答えてください。",
"input": "「代」の音読みは？",
"output": "タイ",
"thinking": "この漢字は「代」です。 小学3年生で習う漢字です。 意味は「substitute」などです。 音読み（おんよみ）は中国から伝わった読み方です。 この漢字の音読みは「タイ」です。",
"answer": "タイ"… See the full description on the dataset page: https://huggingface.co/datasets/AkabekoLabs/nihongo-dojo-grades1-2-3-kanji_reading.turk_ceza_kanunlari
🇹🇷 Türk Ceza Kanunu Soru-Cevap & RAG Veri Seti
Bu veri seti, Türk hukuk sistemindeki temel kanunları (başta TCK olmak üzere) kapsayan, model eğitimi ve bağlamsal bilgi çıkarma (RAG) süreçleri için optimize edilmiş 7.226 adet zenginleştirilmiş kayıt içermektedir.
📊 Veri Seti Özeti
Özellik
Detay
Toplam Soru
7.000+
Dosya Boyutu
~17.74 MB (JSON)
Kapsanan Mevzuat
TCK, CMK, TMK (3713), KVKK (6698), Trafik (2918), Bahis (7258), Kabahatler (5326) ve fazlası… See the full description on the dataset page: https://huggingface.co/datasets/emin037/turk_ceza_kanunlari.Kannada-Instruct-dataset
Kannada Instruct Dataset
This dataset comprises translated instructional pairs used in the training of Ambari-7B-Instruct, a language model for natural language understanding. The dataset is structured with four columns: original_instruction, original_output, translated_instruction, and translated_output.
original_instruction and original_output contain English instruction and output pairs, respectively, formatted for instruct fine-tuning.
translated_instruction and… See the full description on the dataset page: https://huggingface.co/datasets/Cognitive-Lab/Kannada-Instruct-dataset.Kannada-Dataset-v03tmk-turk-medeni-kanunu-sft
Türk Medeni Kanunu SFT Dataset
📋 Dataset Açıklaması
4721 sayılı Türk Medeni Kanunu'na dayalı temel SFT veri seti.
📖 Kaynak Mevzuat
4721 sayılı Türk Medeni Kanunu
Kaynak mevzuat Türkiye Cumhuriyeti'nin kamuya açık resmî metnidir.
⚖️ Lisans
CC BY 4.0 — Creative Commons Attribution 4.0 International
Kaynak mevzuat kamuya açık resmî metin olup bu veri seti ve üretilen katkılar aynı lisans altında paylaşılabilir.
Kaynak belirtilmek kaydıyla serbestçe… See the full description on the dataset page: https://huggingface.co/datasets/kilicai/tmk-turk-medeni-kanunu-sft.layra-kanna-goldset
LAYRA: Large Academic Visual RAG Gold Set (Kanna)
This dataset contains the evaluation artifacts for LAYRA (Large Academic Visual RAG Agent), a specialized Visual RAG system for academic literature focused on the ethnopharmacology of Sceletium tortuosum (Kanna).
Project Overview
LAYRA utilizes ColQwen2.5 (Late-Interaction VLM) to retrieve full PDF pages by embedding visual layouts, charts, and scientific figures directly, bypassing the information loss inherent in… See the full description on the dataset page: https://huggingface.co/datasets/SAINTHALF/layra-kanna-goldset.tmk-turk-medeni-kanunu-sft-esya-500
Türk Medeni Kanunu Eşya Hukuku SFT Dataset (500)
📋 Dataset Açıklaması
4721 sayılı Türk Medeni Kanunu Eşya Hukuku kitabına dayalı 517 satırlık SFT veri seti.
📖 Kaynak Mevzuat
4721 sayılı Türk Medeni Kanunu - Eşya Hukuku
Kaynak mevzuat Türkiye Cumhuriyeti'nin kamuya açık resmî metnidir.
⚖️ Lisans
CC BY 4.0 — Creative Commons Attribution 4.0 International
Kaynak mevzuat kamuya açık resmî metin olup bu veri seti ve üretilen katkılar aynı lisans altında… See the full description on the dataset page: https://huggingface.co/datasets/kilicai/tmk-turk-medeni-kanunu-sft-esya-500.tmk-turk-medeni-kanunu-sft-esya-1000
Türk Medeni Kanunu Eşya Hukuku SFT Dataset (1000)
📋 Dataset Açıklaması
4721 sayılı Türk Medeni Kanunu Eşya Hukuku kitabına dayalı 970 satırlık SFT veri seti.
📖 Kaynak Mevzuat
4721 sayılı Türk Medeni Kanunu - Eşya Hukuku
Kaynak mevzuat Türkiye Cumhuriyeti'nin kamuya açık resmî metnidir.
⚖️ Lisans
CC BY 4.0 — Creative Commons Attribution 4.0 International
Kaynak mevzuat kamuya açık resmî metin olup bu veri seti ve üretilen katkılar aynı lisans… See the full description on the dataset page: https://huggingface.co/datasets/kilicai/tmk-turk-medeni-kanunu-sft-esya-1000.tapu-kanunu-2644-sft-dataset
2644 Sayılı Tapu Kanunu SFT Dataset
📋 Dataset Açıklaması
2644 sayılı Tapu Kanunu maddelerine dayalı SFT veri seti. Tapu sicili işlemleri, tescil, terkin, rehin, irtifak hakları ve ilgili prosedürler kapsamında üretilmiş soru-cevap çiftleri içerir.
📖 Kaynak Mevzuat
2644 sayılı Tapu Kanunu
Kaynak mevzuat Türkiye Cumhuriyeti'nin kamuya açık resmî metnidir.
⚖️ Lisans
CC BY 4.0 — Creative Commons Attribution 4.0 International
Kaynak mevzuat kamuya açık… See the full description on the dataset page: https://huggingface.co/datasets/kilicai/tapu-kanunu-2644-sft-dataset.tmk-turk-medeni-kanunu-sft-400
Türk Medeni Kanunu SFT Dataset (400)
📋 Dataset Açıklaması
4721 sayılı Türk Medeni Kanunu'na dayalı 402 satırlık SFT veri seti.
📖 Kaynak Mevzuat
4721 sayılı Türk Medeni Kanunu
Kaynak mevzuat Türkiye Cumhuriyeti'nin kamuya açık resmî metnidir.
⚖️ Lisans
CC BY 4.0 — Creative Commons Attribution 4.0 International
Kaynak mevzuat kamuya açık resmî metin olup bu veri seti ve üretilen katkılar aynı lisans altında paylaşılabilir.
Kaynak belirtilmek… See the full description on the dataset page: https://huggingface.co/datasets/kilicai/tmk-turk-medeni-kanunu-sft-400.tbk-turk-borclar-kanunu-sft-1000
Türk Borçlar Kanunu SFT Dataset (1000)
📋 Dataset Açıklaması
6098 sayılı Türk Borçlar Kanunu'na dayalı 1000 satırlık SFT veri seti.
📖 Kaynak Mevzuat
6098 sayılı Türk Borçlar Kanunu
Kaynak mevzuat Türkiye Cumhuriyeti'nin kamuya açık resmî metnidir.
⚖️ Lisans
CC BY 4.0 — Creative Commons Attribution 4.0 International
Kaynak mevzuat kamuya açık resmî metin olup bu veri seti ve üretilen katkılar aynı lisans altında paylaşılabilir.
Kaynak belirtilmek… See the full description on the dataset page: https://huggingface.co/datasets/kilicai/tbk-turk-borclar-kanunu-sft-1000.kanna-rag-gold-standard
Kanna RAG Gold Standard Dataset
This dataset contains 30 expert-curated Question-Answer pairs focused on the ethnopharmacology of Sceletium tortuosum (Kanna). It serves as the "Gold Standard" evaluation set for the LAYRA (Large Academic Visual RAG Agent) thesis project.
Dataset Structure
query: The scientific question.
doc_id: The unique identifier of the source document (PDF).
page_num: The specific page number where the answer is found (critical for Visual RAG).… See the full description on the dataset page: https://huggingface.co/datasets/SAINTHALF/kanna-rag-gold-standard.