datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
linux-commands
LinLM Dataset
A curated synthetic dataset for Linux command inference
Natural language description -> shell commands
Features:
Supports 10 languages
Arch Linux commands recognition
Fine-tune LLM for development, system administration, file operations, Git, Docker, and more
Usage
from datasets import load_dataset
dataset = load_dataset("missvector/linux-commands")
def format_for_training(example):
return {
"prompt": f"Convert to Linux command:… See the full description on the dataset page: https://huggingface.co/datasets/missvector/linux-commands.oxe-magic-soup-plus-nl-commands
OXE Magic Soup++ Natural Language Commands
Per-step natural-language instructions extracted from the datasets in the OpenVLA oxe_magic_soup_plus mixture of Open X-Embodiment (OXE). Source datasets were downloaded and preprocessed with rlds_dataset_mod, following OpenVLA, then processed with oxe-stats.
Files
One CSV per source dataset:
oxe-<dataset>_nl_only.csv — train split
oxe-<dataset>_validation_nl_only.csv — all non-train splits, merged
Columns… See the full description on the dataset page: https://huggingface.co/datasets/agnesluhtaru/oxe-magic-soup-plus-nl-commands.Natural_Language_to_Ffmpeg_Commands
Natural Language to FFmpeg Dataset
Disclaimer: This dataset was synthetically generated using a large language model and is intended for research purposes only. The dataset may contain inaccuracies, errors, or inconsistencies. Users should exercise caution and verify the correctness of the data before using it in any application.
This dataset contains 1000+ pairs of English natural language instructions and corresponding FFmpeg commands.
The dataset is designed for tasks… See the full description on the dataset page: https://huggingface.co/datasets/burak29/Natural_Language_to_Ffmpeg_Commands.cli-commands-explained
Overview
This dataset is a collection of 16,098 command line instructions sourced from Commandlinefu and Cheatsheets. It includes an array of commands, each with an id, title, description, date, url to source, author, votes, and flag indicating if the description is AI generated. The descriptions are primarily authored by the original contributors, for entries where descriptions were absent, they have been generated using NeuralBeagle14-7B. Out of the total entries, 10,039… See the full description on the dataset page: https://huggingface.co/datasets/b-mc2/cli-commands-explained.linux-commands
LinLM Dataset
A curated synthetic dataset for Linux command inference
Natural language description -> shell commands
Features:
Supports 10 languages
Arch Linux commands recognition
Fine-tune LLM for development, system administration, file operations, Git, Docker, and more
Usage
from datasets import load_dataset
dataset = load_dataset("missvector/linux-commands")
def format_for_training(example):
return {
"prompt": f"Convert to Linux command:… See the full description on the dataset page: https://huggingface.co/datasets/shanthropic/linux-commands.git-natural-language-commands
Git Natural Language Commands
A dataset mapping English natural-language instructions to their corresponding git commands, intended for training and evaluating models that translate user intent into safe, correct shell commands.
Disclaimer: This dataset was generated using Large Language Models (LLMs). The examples have not been manually verified against real-world usage and may contain errors, inconsistencies, or non-canonical phrasings. Use with appropriate caution.… See the full description on the dataset page: https://huggingface.co/datasets/burak29/git-natural-language-commands.linux-commands
LinLM Dataset
A curated synthetic dataset for Linux command inference
Natural language description -> shell commands
Features:
Supports 10 languages
Arch Linux commands recognition
Fine-tune LLM for development, system administration, file operations, Git, Docker, and more
Usage
from datasets import load_dataset
dataset = load_dataset("missvector/linux-commands")
def format_for_training(example):
return {
"prompt": f"Convert to Linux command:… See the full description on the dataset page: https://huggingface.co/datasets/amechanicus/linux-commands.unix-commands
Unix Commands Dataset
Description
The Unix Commands Dataset is a unique collection of real-world Unix command line examples, captured from various system prompts representing different user roles and responsibilities, such as system administrators, DevOps, network administrators, Docker administrators, regular users, and hackers.
The dataset consists of Unix commands ranging from basic to advanced levels and from a wide array of categories, including file operations (ls… See the full description on the dataset page: https://huggingface.co/datasets/harpomaxx/unix-commands.linux-commands
LinLM Dataset
A curated synthetic dataset for Linux command inference
Natural language description -> shell commands
Features:
Supports 10 languages
Arch Linux commands recognition
Fine-tune LLM for development, system administration, file operations, Git, Docker, and more
Usage
from datasets import load_dataset
dataset = load_dataset("missvector/linux-commands")
def format_for_training(example):
return {
"prompt": f"Convert to Linux command:… See the full description on the dataset page: https://huggingface.co/datasets/Rendra8631/linux-commands.rc-car-commands
RC-Car Command Dataset
A hand-authored dataset for training a tiny language model that maps a natural-language command to a structured list of tool calls (LangChain/LangGraph style), to drive an RC car via a NodeMCU.
File: data/rc_dataset.csv
Columns: input (natural language), output (JSON tool-call list)
Rows: 700
Task type: sequence-to-sequence (translation)
Output grammar
Each output is a JSON array of tool-call objects:
[{"name":"Forward"… See the full description on the dataset page: https://huggingface.co/datasets/0xAbhi/rc-car-commands.bash-commands-dataset-rev-ja
trtd56/bash-commands-dataset-rev-ja
bash_commands_ja.csv から作成した、Bash コマンドを入力して日本語説明を出力するためのデータセットです。
Columns
prompt_ja: 日本語説明
prompt_en: 英語説明
response: Bash コマンド
prompt: 学習用入力。response と同じ
completion: 学習用出力。prompt_ja と同じ
task: タスク識別子
language: 出力言語
Splits
train: 756
test: 84
Usage
from datasets import load_dataset
ds = load_dataset("trtd56/bash-commands-dataset-rev-ja")
print(ds["train"][0]["prompt"])
print(ds["train"][0]["completion"])
linux-commands
LinLM Dataset
A curated synthetic dataset for Linux command inference
Natural language description -> shell commands
Features:
Supports 10 languages
Arch Linux commands recognition
Fine-tune LLM for development, system administration, file operations, Git, Docker, and more
Usage
from datasets import load_dataset
dataset = load_dataset("missvector/linux-commands")
def format_for_training(example):
return {
"prompt": f"Convert to Linux command:… See the full description on the dataset page: https://huggingface.co/datasets/chowmean/linux-commands.shellsmith-commands
shellsmith-commands
Curated (natural-language instruction → shell command) pairs for macOS/Linux,
used to fine-tune Qwen2.5-Coder-1.5B-Shellsmith.
Format
JSONL in chat format (mlx-lm / OpenAI style):
{"messages": [
{"role": "system", "content": "You are a shell command generator ..."},
{"role": "user", "content": "list files sorted by size, largest first"},
{"role": "assistant", "content": "ls -lS"}
]}
Splits
File
Rows
train.jsonl… See the full description on the dataset page: https://huggingface.co/datasets/ajayk007/shellsmith-commands.linux-commandslinux-commands
LinLM Dataset
A curated synthetic dataset for Linux command inference
Natural language description -> shell commands
Features:
Supports 10 languages
Arch Linux commands recognition
Fine-tune LLM for development, system administration, file operations, Git, Docker, and more
Usage
from datasets import load_dataset
dataset = load_dataset("missvector/linux-commands")
def format_for_training(example):
return {
"prompt": f"Convert to Linux command:… See the full description on the dataset page: https://huggingface.co/datasets/jasmar2/linux-commands.common-dev-commands-en-ko
Common Linux Commands (Korean-English)
A bilingual dataset for translating natural language instructions into Linux/Unix commands.
Dataset Description
This dataset contains 12,250 examples of natural language queries (in both Korean and English) paired with their corresponding Linux/Unix commands. It covers 82 different command-line tools commonly used in system administration and development.
Dataset Structure
{
"korean_question": "production.ini 인벤토리 써서… See the full description on the dataset page: https://huggingface.co/datasets/TGoddessana/common-dev-commands-en-ko.