datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
the-stack-rust-clean
Dataset 1: TheStack - Rust - Cleaned
Description: This dataset is drawn from TheStack Corpus, an open-source code dataset with over 3TB of GitHub data covering 48 programming languages. We selected a small portion of this dataset to optimize smaller language models for Rust, a popular statically typed language.
Target Language: Rust
Dataset Size:
Training: 900,000 files
Validation: 50,000 files
Test: 50,000 files
Preprocessing:
Selected Rust as the target language due to its… See the full description on the dataset page: https://huggingface.co/datasets/ammarnasr/the-stack-rust-clean.Kazakh-Russian-Child-Directed-Speech-Corpus
Kazakh-Russian Child-Directed Language Corpus
Dataset Description
The corpus combines narrative texts and child-adult dialogue transcripts in Kazakh and Russian. It was created to support research on low-resource NLP, language acquisition, language modeling, and morphologically aware tokenization.
The corpus includes narrative materials such as fairy tales, children’s literature, cartoons/subtitles, translated stories, and educational texts.
This dataset is a work… See the full description on the dataset page: https://huggingface.co/datasets/esimijoq/Kazakh-Russian-Child-Directed-Speech-Corpus.ru-big-russian-dataset
Big Russian Dataset
Made by ZeroAgency.ru - telegram channel.
Dataset size
Train: 1 710 601 samples (filtered from 2_149_360)
Test: 18 520 samples (not filtered)
English
The Big Russian Dataset is a combination of various primarily Russian‑language datasets. With some sort of reasoning!
The dataset was deduplicated, cleaned, scored using gpt-4.1 and filtered.
Русский
Big Russian Dataset - большой русский датасет. Комбинация из… See the full description on the dataset page: https://huggingface.co/datasets/ZeroAgency/ru-big-russian-dataset.russian_super_glueRecent advances in the field of universal language models and transformers require the development of a methodology for
their broad diagnostics and testing for general intellectual skills - detection of natural language inference,
commonsense reasoning, ability to perform simple logical operations regardless of text subject or lexicon. For the first
time, a benchmark of nine tasks, collected and organized analogically to the SuperGLUE methodology, was developed from
scratch for the Russian language. We provide baselines, human level evaluation, an open-source framework for evaluating
models and an overall leaderboard of transformer models for the Russian language.russian_dialogues_2
Den4ikAI/russian_dialogues_2
Датасет русских диалогов для обучения диалоговых моделей.
Количество диалогов - 1.6 миллиона
Формат датасета:
{
'sample': ['Привет', 'Привет', 'Как дела?']
}
Citation:
@MISC{russian_instructions,
author = {Denis Petrov},
title = {Russian context dialogues dataset for conversational agents},
url = {https://huggingface.co/datasets/Den4ikAI/russian_dialogues_2},
year = 2023
}
russian-it-community-corpus
📦 Russian IT Community Corpus (RICC)
Russian IT Community Corpus (RICC) is an open, de-identified conversational dataset collected from 11 engineering community nodes spanning a 9-year timeline (2017–2026). It captures authentic discussions on backend systems, cloud infrastructure, AI/ML deployment, database internals, and software architecture.
The corpus is structured into ready-to-use splits for Instruction Fine-Tuning (SFT), Direct Preference Optimization (DPO)… See the full description on the dataset page: https://huggingface.co/datasets/wwewtech/russian-it-community-corpus.khakas-russian-parallel-corpus
Khakas-Russian Parallel Corpus
The creation of this dataset is aimed at supporting the development of natural language processing (NLP) tools and
machine translation for the Khakas language, which is classified as a "Definitely Endangered" language. By providing
high-quality parallel data, this project helps preserve the linguistic heritage of the Khakas people.
Dataset Overlap:
The Khakas sentences in this corpus do not overlap with those in the Khakas… See the full description on the dataset page: https://huggingface.co/datasets/adeshkin/khakas-russian-parallel-corpus.ru_sharegpt_cleanedkhakas-russian-dict
Khakas-Russian Dictionary (Dataset)
Dataset Developer: Vasily AdeshkinContact for inquiries: adeshkin.vi@phystech.edu
📌 Important Notice & Citation
When using this dataset, please be sure to cite this repository and the original dictionary: https://khakas.altaica.ru/dictionary/.
Please note: Some optical character recognition (OCR) errors may still be present in the data.
🛠 Contribution & Authorship
I am not the author of the original dictionary, but I have… See the full description on the dataset page: https://huggingface.co/datasets/adeshkin/khakas-russian-dict.physics-russian
Оглавление
Описание датасета
Аннотация
Ключевые особенности
Статус перевода
Методология перевода и верификации
Ограничения и возможные погрешности
Структура датасета
Поля данных
Использование
Благодарности
Лицензирование и авторские права
Цитирование
📑 Оглавление Примеров
Нажмите на тему, чтобы перейти к соответствующему разделу в полном отчёте.
Квантовая механика
Термодинамика
Электромагнетизм
Общая теория относительности
Специальная теория относительности
Атомная… See the full description on the dataset page: https://huggingface.co/datasets/AITISPEC/physics-russian.russian-nmo-medical-mcq
Russian NMO Medical MCQ
Choose language / Выберите язык: Русский | English
Русский
Это датасет русскоязычных медицинских тестовых вопросов НМО с вариантами ответа.
В нем есть вопросы с одним правильным вариантом и вопросы с несколькими правильными
вариантами. Датасет подготовлен так, чтобы его можно было сразу использовать для
тонкой настройки LLM, проверки качества ответов и экспериментов с медицинским QA.
Главная идея простая: дать модели вопрос, тему и варианты ответа… See the full description on the dataset page: https://huggingface.co/datasets/drkolesnikov/russian-nmo-medical-mcq.russian_literature
RusLit Corpus
A corpus of Russian literature in clean text format.
Description
This dataset contains cleaned text (stripped of extraneous artifacts) collected from works by authors who passed away more than 70 years ago, placing them in the public domain.
Some texts may contain semantic nonsense (e.g. OCR or digitization artifacts), as well as fragments of French, German, English, or Japanese text mixed in with the Russian.
Structure
Each record… See the full description on the dataset page: https://huggingface.co/datasets/RafaelUI/russian_literature.Rust-Coder
Rust-Coder
Rust-Coder is a comprehensive text dataset designed for Rust programming language learning. It contains 12,000 unique samples focusing on distinct Rust concepts, code snippets, and explanations.
Dataset Structure
Each sample consists of:
id: A unique UUID.
instruction: A prompt or question about a Rust concept.
code: An idiomatic Rust code snippet.
explanation: A detailed explanation of the concept and code.
category: The high-level Rust category (e.g.… See the full description on the dataset page: https://huggingface.co/datasets/Convence/Rust-Coder.GSM8k_Kazakh_Russian
Dataset Summary
These are the machine-translated Kazakh and Russian versions of the GSM8K (Grade School Math 8K) dataset (test set).
This dataset is used to test the mathematical reasoning of large language models in the Kazakh language. Specifically, GSM8K focuses on high-quality grade school math word problems that require multi-step reasoning to solve. Kazakh and Russian versions serve as a benchmark for evaluating how well models can perform mathematical reasoning and… See the full description on the dataset page: https://huggingface.co/datasets/issai/GSM8k_Kazakh_Russian.russian_jokesrussian_instructions_2_cleaned
Russian Instructions Cleaned
Очищенная версия Den4ikAI/russian_instructions_2.
Что сделано
Дедупликация по question (удалено ~45k)
Удалены пустые question и answer
Удалены ответы короче 100 и длиннее 4000 символов
Конвертировано в chat-формат (messages: user/assistant)
Статистика
Метрика
Значение
Исходно
237 281
После чистки
138 973
Удалено
98 308 (41%)
Формат
JSONL, одна строка = один пример.
{"messages":… See the full description on the dataset page: https://huggingface.co/datasets/Lev384501/russian_instructions_2_cleaned.rust
Complete Rust Compilation Pipeline Dataset
This dataset contains the most comprehensive analysis of Rust compilation ever created, covering the complete pipeline from source code to LLVM IR generation.
🚀 UNPRECEDENTED SCOPE
This dataset captures every stage of Rust compilation:
Rust Source → rustc → LLVM IR → Optimizations → Machine Code
↓ ↓ ↓ ↓ ↓
Semantic Project IR Gen Optimization Assembly
Analysis Analysis… See the full description on the dataset page: https://huggingface.co/datasets/introspector/rust.bioleaflets-biomedical-ner
Dataset Card for BioLeaflets Dataset
Dataset Summary
BioLeaflets is a biomedical dataset for Data2Text generation. It is a corpus of 1,336 package leaflets of medicines authorised in Europe, which were obtained by scraping the European Medicines Agency (EMA) website.
Package leaflets are included in the packaging of medicinal products and contain information to help patients use the product safely and appropriately.
This dataset comprises the large majority (∼ 90%) of… See the full description on the dataset page: https://huggingface.co/datasets/ruslan/bioleaflets-biomedical-ner.russian_dpo_qa
Format
Each row contains:
prompt
chosen
rejected
Usage
from datasets import load_dataset
dataset = load_dataset("eridai/russian_dpo_qa")
train = dataset["train"]
rust-code-suite
NickIBrody/rust-code-suite
Rust Code Suite is a public raw Rust source corpus built from open-source repositories and selected historical git revisions.
Splits
train.jsonl
validation.jsonl
test.jsonl
Schema
{
"id": "owner/repo:path:chunk",
"text": "...",
"arch": "rust",
"syntax": "rust",
"kind": "rust-source",
"repo": "owner/repo",
"path": "src/lib.rs",
"license": "GPL-2.0",
"commit": "abcdef123456",
"source_url":… See the full description on the dataset page: https://huggingface.co/datasets/NickIBrody/rust-code-suite.RusLang-edu-1000
RusLang-Edu-1000 — an educational Russian-language QA dataset
RusLang-Edu-1000 is an expert-curated dataset of 1,000 instruction-format records ("question — detailed educational answer") covering the Russian language and linguistics: from phonetics and orthography to dialectology and theoretical linguistics. Every record contains a detailed answer (on average ≈1,100 characters), a short reference answer, a concise statement of the rule, and rich annotation (subject area, task… See the full description on the dataset page: https://huggingface.co/datasets/DatasetsEval/RusLang-edu-1000.rus_med_dialogues
Russian-language dataset of 2282 patient conversations in a medical bot.
The training sample includes 2053 conversations;
The test sample includes 229 conversations;
Feature characteristics:
topic - medical topic
context - user-ai message history
user_question - last user question
assistant_answer - ai answer according the context and topic
prompt - ready prompt for fincetuning instruct model (adapted for using with unsloth… See the full description on the dataset page: https://huggingface.co/datasets/Mykes/rus_med_dialogues.russian-easy-instructions
Easy Russian Instructions
Fast instructions in conversational format, generaly used for injecting general knowledge.Dataset contains comprehensive instructions for easy tasks and general question answering
Contents:
Wikipedia / Factological knowledge
History knowledge
Basic programming understanding
Basic math understanding
Basic physics understanding
Basic geography knowledge
Basic biology knowledge
Format:
Formatted for instruction-tuning / instruction… See the full description on the dataset page: https://huggingface.co/datasets/attn-signs/russian-easy-instructions.keyphrase_extraction_russianA dataset for extracting or generating keywords for scientific texts in Russian. It contains annotations of scientific articles from four domains: mathematics and computer science (a fragment of the Keyphrases CS&Math Russian dataset), history, linguistics, and medicine. For more details about the dataset please refer the original paper: https://arxiv.org/abs/2409.10640
Dataset Structure
abstract, an abstract in a string format;
keywords, a list of keyphrases provided by… See the full description on the dataset page: https://huggingface.co/datasets/aglazkova/keyphrase_extraction_russian.ru_stackoverflow
Russian StackOverflow dataset
Description
Summary: Dataset of questions, answers, and comments from ru.stackoverflow.com.
Script: create_stackoverflow.py
Point of Contact: Ilya Gusev
Languages: The dataset is in Russian with some programming code.
Usage
Prerequisites:
pip install datasets zstandard jsonlines pysimdjson
Loading:
from datasets import load_dataset
dataset = load_dataset('IlyaGusev/ru_stackoverflow', split="train")
for example in dataset:… See the full description on the dataset page: https://huggingface.co/datasets/IlyaGusev/ru_stackoverflow.mem-and-russian-jokes-dataset
2 июля 2025
Добавлено новых уникальных анекдотов: 1311963
Количество записей в датасете: 521904
Добавил датасет анекдотов от IgorVolochay/russian_jokes
не понимаю как я прошел мимо него, там очень много шуток,
сам Евгений Ваганович очень часто обращался к этому датасету... Но вот и мое время пришло.
Плюс обновил старый датасет и разбавил формулировки новыми начальными вопросами
human_prompts = [
"Расскажи шутку",
"Расскажи анекдот",
"Знаешь какой-нибудь прикол?",
"Скажи что-нибудь смешное"… See the full description on the dataset page: https://huggingface.co/datasets/samedad/mem-and-russian-jokes-dataset.Rust-Coder
Rust-Coder
Rust-Coder is a comprehensive text dataset designed for Rust programming language learning. It contains 12,000 unique samples focusing on distinct Rust concepts, code snippets, and explanations.
Dataset Structure
Each sample consists of:
id: A unique UUID.
instruction: A prompt or question about a Rust concept.
code: An idiomatic Rust code snippet.
explanation: A detailed explanation of the concept and code.
category: The high-level Rust category (e.g.… See the full description on the dataset page: https://huggingface.co/datasets/gubernac/Rust-Coder.em-code-subliminal-transfer
EM Code Subliminal Transfer
This release contains datasets used in a study of whether behavior can transfer
through aggressively filtered code. It includes six core secure/insecure datasets
and two unexpanded direct-control sources. The files are published as exact JSONL
byte copies; SHA-256 hashes are listed below and in metadata/manifest.json.
[!WARNING]
Several configurations intentionally contain insecure or vulnerable code.
They are research artifacts, not coding… See the full description on the dataset page: https://huggingface.co/datasets/rustem17/em-code-subliminal-transfer.RussianFinancialNews
RussianFinancialNews
Датасет содержит 92,377 русскоязычных новостных статей на финансовую тематику, преимущественно про российский рынок ценных бумаг и российскую экономику. Набор данных может быть полезен для разных задач обработки естественного языка (NLP).
A dataset containing 92,377 samples of Russian financial news articles. Each sample includes metadata and content fields that are useful for various Natural Language Processing (NLP) tasks.
Dataset Summary… See the full description on the dataset page: https://huggingface.co/datasets/Kasymkhan/RussianFinancialNews.Magicoder-OSS-Instruct-Rust-cleaned-3.9K
🦀 Magicoder-OSS-Instruct-Rust (3.9K Cleaned)
Magicoder-OSS-Instruct-Rust is a high-quality, syntax-verified dataset of 3,909 Rust coding instructions derived from real-world open-source GitHub projects.
This dataset is extracted from ise-uiuc/Magicoder-OSS-Instruct-75K, filtered specifically for Rust, and validated via in-memory compiler checks. No language translation was applied; the dataset remains in its original English format.
⚙️ Filtering and Verification… See the full description on the dataset page: https://huggingface.co/datasets/WrittenWithRust/Magicoder-OSS-Instruct-Rust-cleaned-3.9K.