datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
bashbench2
BashBench2
A successor in spirit to the original BashBench, this dataset is intended for high-stakes agentic control research using current and near-future frontier models.
The code required to set up and run these tasks is located in ControlArena.
ShIO-bash-26.1
ShIO-bash-26.1
Shell input-output (ShIO) Bash dataset produced by ShIOEnv, a Gymnasium-compatible Bash environment designed to collect execution-annotated command interactions in a Linux system.
Dataset summary
The dataset consists of command-line inputs paired with their execution artifacts, including observable outputs and a structured representation of environment state changes. Samples are produced by executing synthesized Bash inputs inside a… See the full description on the dataset page: https://huggingface.co/datasets/jragsdale1/ShIO-bash-26.1.bashkort_commands_omnivoice
Bashkort Commands OmniVoice
Partial eleven-label command snapshot generated with k2-fsa/OmniVoice
using the same cross-lingual voice-cloning recipe as
AigizK/homai_wake_word_omnivoice. Generation was stopped at the user's
request after 41,525 complete reference groups had been committed.
For every included reference row from the train split of:
bond005/sova_rudevices
the dataset contains one recording of every command:
Айвика — Russian
Айвикә — Bashkir
Айһылыу — Bashkir… See the full description on the dataset page: https://huggingface.co/datasets/AigizK/bashkort_commands_omnivoice.broadcast-speech
Bashkir Broadcast Speech — Radio and Television
53.3 hours of speech in 293 recordings in the Bashkir language, from television and radio programmes produced by two public broadcasters of the Republic of Bashkortostan. Audio only — no transcripts in this release — which makes the set suitable for self-supervised speech pretraining for a low-resource Turkic language.
🌐 Languages of this card: English · Башҡортса · Русский
Part of the Bashkorttele dataset series — preservation… See the full description on the dataset page: https://huggingface.co/datasets/bashkorttele/broadcast-speech.bash-commands-dataset
🐧 Linux Command Automation Dataset
A dataset of natural language prompts paired with their corresponding Bash command-line equivalents, designed to train or fine-tune models for automating Linux tasks via natural language.
📁 Dataset Structure
The dataset is in JSON format, structured as a flat array of objects, where each object contains:
{
"prompt": "Natural language description of a task",
"response": "Equivalent Bash command"
}
✅ Example
{… See the full description on the dataset page: https://huggingface.co/datasets/aelhalili/bash-commands-dataset.bash-instruct-III-55k
Bash Instruct III — 54,360 verified natural-language → Bash pairs
Bash Instruct III is a synthetic instruction-tuning dataset that maps natural-language
requests to correct Bash: single commands, short pipelines, and multi-line scripts. It
is built for supervised fine-tuning of small and mid-size LLMs that must turn a plain
request into shell code that actually runs.
Every row is a three-turn chat conversation (system / user / assistant) with metadata
for slicing (category… See the full description on the dataset page: https://huggingface.co/datasets/Frost2o24/bash-instruct-III-55k.bashkir-frequency-index
Bashkir Frequency Index v11.5
Word-frequency index for Bashkir, computed over a large monolingual
Bashkir-language dataset, for NLP, spellchecking and lexical research.
Overview
Word-frequency index for the Bashkir language computed over a large monolingual
Bashkir-language dataset. Non-Bashkir admixture, borrowed vocabulary
and scanning artifacts were reduced with automated language filtering. The
public configuration (count ≥ 3) is the recommended default;… See the full description on the dataset page: https://huggingface.co/datasets/failed09/bashkir-frequency-index.trilingual-parallel-phrasebooks-bgpu
Bashkir Trilingual Parallel Phrasebooks
9,857 phrases aligned across three languages — Bashkir, Russian and one of Altai, Arabic, Kazakh, Yakut (Sakha), Chinese — from five phrasebooks published by M. Akmulla Bashkir State Pedagogical University. One row is one phrase in all three languages: a parallel corpus for machine translation and cross-lingual work with a low-resource Turkic language. Each phrasebook is a separate file and a separate config, because the third language… See the full description on the dataset page: https://huggingface.co/datasets/bashkorttele/trilingual-parallel-phrasebooks-bgpu.bash_command_data_6K
📦 Bash Command Dataset v1
A high-quality dataset of natural language instructions paired with their equivalent Bash commands, designed for training and fine-tuning large language models (LLMs) that translate English tasks into shell commands.
This dataset is ideal for researchers, developers, and machine learning engineers interested in natural language to Bash command translation, command-line automation, and building intelligent terminal assistants.
📁 Dataset… See the full description on the dataset page: https://huggingface.co/datasets/emirkaanozdemr/bash_command_data_6K.bashkir-wikipedia-parallel
Bashkir-Russian Wikipedia Parallel Corpus
Sentence-level Bashkir-Russian parallel text from Wikipedia, scored and filtered
for machine translation.
Overview
Sentence-level Bashkir-Russian parallel dataset extracted from the corresponding
Bashkir and Russian Wikipedia dumps dated 2026-08-01. Candidate pairs are scored
for semantic alignment with multilingual sentence encoders (Meta LASER3, Google
LaBSE) and the in-domain Bashkir-Russian Pair Scorer. The filtered… See the full description on the dataset page: https://huggingface.co/datasets/failed09/bashkir-wikipedia-parallel.bashkort_voice
Bashkort Voice
🇬🇧 English Version
Dataset Description
This is a synthetic Bashkir audio dataset generated using the OmniVoice model. It is designed to expand the availability of spoken data for the Bashkir language.
Data Preparation Process
The dataset was constructed through a cross-lingual voice cloning and generation process, using the following methodology:
Target Text: Bashkir sentences were extracted from the AigizK/bashkir-russian-parallel-corpora dataset.… See the full description on the dataset page: https://huggingface.co/datasets/AigizK/bashkort_voice.bashkir-multilingual-phrasebooks
Bashkir-Russian Phrasebook Corpus
Edited Bashkir-Russian words, expressions and conversational phrases from
university phrasebooks, annotated by entry type.
Overview
Edited Bashkir-Russian pairs derived from the original
bashkorttele/trilingual-parallel-phrasebooks-bgpu
dataset, published by Bashkorttele from phrasebooks of M. Akmulla Bashkir State
Pedagogical University. The cleaned configuration is the deduplicated default;
reviewed is the edited edition… See the full description on the dataset page: https://huggingface.co/datasets/failed09/bashkir-multilingual-phrasebooks.bashkort_tts_dataset
Bashkort TTS Dataset
The largest open dataset for speech synthesis in the Bashkir language — featuring multi-speaker recordings and speaking styles.
📊 Dataset Overview
Total audio files: 62,852
Speakers: 7 female, 1 male
Speaking styles: friendly, question, neutral
Languages: Bashkir
Format: MP3 audio + transcription text
🎙 How It Was Collected
Initial recording: A female voice actor recorded ~15 hours of speech in Bashkir.
Voice cloning: Using ElevenLabs… See the full description on the dataset page: https://huggingface.co/datasets/AigizK/bashkort_tts_dataset.narrated-audiobooks-brsbs
Narrated Bashkir Audiobooks — BRSBS (Bashkorttele)
≈ 78.7 hours of human-narrated audiobooks, primarily in the Bashkir language, drawn from public-domain literary works and folk epics. Recorded as accessible "talking books" by the Bashkir Republican Special Library for the Blind (BRSBS) and released for language preservation and AI/ML research.
🌐 Languages of this card: English · Башҡортса · Русский
This dataset is part of a larger series published under the Bashkorttele… See the full description on the dataset page: https://huggingface.co/datasets/bashkorttele/narrated-audiobooks-brsbs.SensorCaps
SensorCaps
SensorCaps is an LLM-assisted softly-labelled IMU sensor data captioning dataset with feature summarizations and narrations of human activities.
Abstract
Wearable systems can recognize activities from IMU data but often fail to explain their underlying causes or contextual significance. To address this limitation, we introduce two large-scale resources: SensorCap, comprising 35,960 IMU--caption pairs, and OpenSQA, with 199,701 question--answer pairs designed… See the full description on the dataset page: https://huggingface.co/datasets/BASH-Lab/SensorCaps.bashkir-russian-parallel-corpora
Dataset Card for "bashkir-russian-parallel-corpora"
How the dataset was assembled.
find the text in two languages. it can be a translated book or an internet page (wikipedia, news site)
our algorithm tries to match Bashkir sentences with their translation in Russian
We give these pairs to people to check
@inproceedings{
title={Bashkir-Russian parallel corpora},
author={Iskander Shakirov, Aigiz Kunafin},
year={2023}
}
bashqort-raw
Bashqort Raw Corpus
Description
This dataset contains raw Bashkir text collected for continual training of large language models (LLMs). It is part of the project "Adapting Open-Source LLMs for the Bashkir Language", which aims to evaluate adaptation methods proposed by LlamaTurk (Toraman, 2024) and Persian adaptation (Mahdizadeh Sani et al., 2024).
The corpus is assembled from multiple sources to provide a diverse linguistic foundation for language modeling.… See the full description on the dataset page: https://huggingface.co/datasets/metuKKhud/bashqort-raw.bashkir-wikipedia-monolingual
Bashkir Wikipedia Monolingual Corpus
Cleaned sentence-level Bashkir text from Wikipedia for pretraining, tokenizer
training and linguistic research.
Overview
Sentence-level text extracted from the Bashkir Wikipedia dump (bawiki-20260801),
cleaned and filtered with automated language identification. The cleaned
configuration is the recommended default for language modelling, tokenization and
linguistic research; precleaned is an earlier, lighter extraction kept… See the full description on the dataset page: https://huggingface.co/datasets/failed09/bashkir-wikipedia-monolingual.bash_codeThis dataset is a collection of bash programs from various GitHub repositories and open source projects.
The dataset might contain harmful code.
DCAgent2_terminal_bench_2_DCAgent_bash_textbook_tasks_traces_20251123_000222terminal_bench_2_a1_stack_bash_20260822_024512rl__40GPU_base_32b__exp_rpt_nemotron-bash__Qwen3-32Bbash-instruct-II-55k
Bash Instruct II — 54,803 verified natural-language → Bash pairs
⚠️ Superseded by Bash Instruct III
III is a corrected rebuild of this dataset with shell antipatterns removed at the
generator level (99.8% ShellCheck-clean vs 98.5% here). New work should use III.
The two share 92.5% of their (request, command) pairs, so they must never be
concatenated. This card is kept for reproducibility and citation of published results.
Bash Instruct II is a synthetic… See the full description on the dataset page: https://huggingface.co/datasets/Frost2o24/bash-instruct-II-55k.bashkir-ngram-index
Bashkir Word N-gram Index v11.5
Exact within-sentence word n-gram counts for Bashkir: unigrams, bigrams and
trigrams for spellchecking, OCR post-processing and lightweight language modelling.
Overview
Exact word n-gram counts derived from a monolingual Bashkir-language dataset. The
release provides unigram, bigram and trigram indexes for corpus processing,
spellchecking, OCR post-processing, autocomplete and lightweight language-model
experiments. The unigrams… See the full description on the dataset page: https://huggingface.co/datasets/failed09/bashkir-ngram-index.bash_textbook_tasks_tracesbash_textbook_tasksshellminator-bash-sft105kLLM_Bash
Description of LLM Bash
Prompt designed to convert natural language to bash command.
Inputs
This is a description of the inputs that the prompt expects.
question: User question to be answered by writing a bash command.
Usage
Below is a code snippet for how to use the prompt.
from langchain.prompts import load_prompt
from langchain.chains import LLMBashChain
llm = ...
prompt = load_prompt('lc://prompts/llm_bash/<file-name>')
chain = LLMBashChain(llm=llm… See the full description on the dataset page: https://huggingface.co/datasets/LangChainHub-Prompts/LLM_Bash.dcagent2-terminal-bench-2-dcagent-bash-textbook-tasks-traces-20251122-123745bash-instruct-55k
Bash Instruct I — 55,000 verified natural-language → Bash pairs
⚠️ Superseded by Bash Instruct III
III doubles the utility vocabulary (89 → 182), adds grouped equivalent answers, real
human phrasing from tldr-pages, validation by execution on real Linux, and a style pass
that removes shell antipatterns. New work should use III.
This version remains useful for one specific purpose: it overlaps III by only ~29%, so
it is the one generation that can be deduplicated… See the full description on the dataset page: https://huggingface.co/datasets/Frost2o24/bash-instruct-55k.