datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
osm-polygon-description-tag
OSM Polygon Description Tag
OpenStreetMap polygons with a successfully extracted trimmed non-empty
description or
description:<suffix> tag, published as one GeoParquet file per regional PBF
extract. Every row retains the complete original tag map, full Polygon or
MultiPolygon geometry, WGS84 geodesic area, bounding box, and OSM provenance.
Source repository: github.com/NoeFlandre/osm-polygon-description-tag.
Explore the pipeline metrics in the Trackio dashboard.
Read the… See the full description on the dataset page: https://huggingface.co/datasets/NoeFlandre/osm-polygon-description-tag.resume-job-description-fitdescriptiveness-sentiment-trl-style
TRL's Sentiment and Descriptiveness Preference Dataset
The dataset comes from https://arxiv.org/abs/1909.08593, one of the earliest RLHF work from OpenAI.
We preprocess the dataset using our standard prompt, chosen, rejected format.
Reproduce this dataset
Download the descriptiveness_sentiment.py from the https://huggingface.co/datasets/trl-internal-testing/descriptiveness-sentiment-trl-style/tree/0.1.0.
Run python examples/datasets/descriptiveness_sentiment.py… See the full description on the dataset page: https://huggingface.co/datasets/trl-internal-testing/descriptiveness-sentiment-trl-style.imdb-posters-and-description-512job-descriptions200k_HEAVY_gpt4o-description-gpt4omini-code_generated_problemsHere is the dataset of ~100k synthetic data generated by 162 seeds.
We generate the dataset with the following steps and two approaches:
Generate ~110k descriptions by GPT4o.
Approach 1: Generate ~110k codes follow each description by GPT4o-mini.
Approach 2: Generate ~110k codes follow each description by GPT4o-mini and suggest it to use specific library functions.
Run the ~220k codes and do auto-filtering.
Get the final ~200k legitimate ARC-like tasks with examples.
job_titles_and_descriptions
IT Job Roles, Skills, and Descriptions Dataset
This dataset provides detailed information about various IT job roles, the required skills for each role, and the job descriptions that outline the responsibilities and qualifications associated with each position. It is designed for use in applications such as career guidance systems, job recommendation engines, and educational tools aimed at aligning skills with industry demands.
Dataset Upload
This dataset is uploaded… See the full description on the dataset page: https://huggingface.co/datasets/NxtGenIntern/job_titles_and_descriptions.Mixed_Closed_with_Descriptionrecruitment-dataset-job-descriptions-english
Djinni Dataset (English Job Descriptions part)
Overview
The Djinni Recruitment Dataset (English Job Descriptions part) contains 150,000 job descriptions and 230,000 anonymized candidate CVs, posted between 2020-2023 on the Djinni IT job platform. The dataset includes samples in English and Ukrainian.
The dataset contains various attributes related to job descriptions, including position titles, job descriptions, company names, experience requirements, keywords, English… See the full description on the dataset page: https://huggingface.co/datasets/lang-uk/recruitment-dataset-job-descriptions-english.UTD-descriptions
📝 UTD‑descriptions Dataset
The UTD‑descriptions dataset provides multiple kinds of textual descriptions for video samples belonging to 12 widely used video understanding datasets (e.g., Kinetics‑400, UCF101, HMDB51, DiDeMo, ActivityNet, MSR‑VTT, Charades, etc.).It contains no video files — instead, it offers captions, attributes, and metadata that correspond to videos stored in their original datasets.
This dataset is ideal for video captioning, multimodal learning, video–language… See the full description on the dataset page: https://huggingface.co/datasets/CVML-TueAI/UTD-descriptions.voxpopuli-mls-de-descriptions
Natural Language Voice Descriptions of the VoxPopuli and MLS German Datasets
German read and parliamentary speech paired with its transcript, acoustic
measurements, discrete German descriptor tags, and a free-text German
description of the speaker's voice and recording conditions. The dataset is intended
for training description-conditioned TTS models such as
Parler-TTS.
The data was built as part of research work. It is a random subset of the
pooled German portions of VoxPopuli… See the full description on the dataset page: https://huggingface.co/datasets/leonhard-behr/voxpopuli-mls-de-descriptions.mls-eng-speaker-descriptions
Dataset Card for Annotations of English MLS
This dataset consists in annotations of the English subset of the Multilingual LibriSpeech (MLS) dataset.
MLS dataset is a large multilingual corpus suitable for speech research. The dataset is derived from read audiobooks from LibriVox and consists of
8 languages - English, German, Dutch, Spanish, French, Italian, Portuguese, Polish. It includes about 44.5K hours of English and a total of about 6K hours for other languages.
This dataset… See the full description on the dataset page: https://huggingface.co/datasets/parler-tts/mls-eng-speaker-descriptions.chinese-meme-description-dataset
Describe image information using the following LLM Models
gpt4o
Claude-3.5-sonnet-20240620
gemini-1.5-pro
gemini-1.5-flash
gemini-1.0-pro-vision
yi-vision
Gemini Code
# -*- coding: gbk -*-
import google.generativeai as genai
import PIL.Image
import os
import json
import shutil
from tqdm import tqdm
from concurrent.futures import ThreadPoolExecutor, as_completed
genai.configure(api_key='')
model = genai.GenerativeModel(
'gemini-1.5-pro-latest'… See the full description on the dataset page: https://huggingface.co/datasets/REILX/chinese-meme-description-dataset.circuitlens-gemma-2-2btranscoder-descriptions-and-evaluations
CircuitLens & WeightLens: Transcoder Descriptions and Evaluations
This dataset contains automatically generated descriptions and evaluation metrics for Gemma-2-2B transcoders, produced using CircuitLens and WeightLens methods.
Methods
CircuitLens: https://github.com/egolimblevskaia/CircuitLens
WeightLens: https://github.com/egolimblevskaia/WeightLens
Dataset Structure
The dataset is organized by layers (0, 4, 7, 10, 12, 15, 18, 21, 23, 25), with each layer… See the full description on the dataset page: https://huggingface.co/datasets/egolimblevskaia/circuitlens-gemma-2-2btranscoder-descriptions-and-evaluations.galaxy-descriptions
Galaxy Descriptions
Project Page | Code
This dataset provides galaxy cutout images, natural-language descriptions, text embeddings, and image embeddings for galaxies drawn from multiple imaging surveys (specifically Legacy DR10 and HSC PDR3 Wide).
Each row corresponds to a single galaxy and contains:
A preprocessed RGB galaxy image
A caption generated by gpt-4.1-mini
A single-sentence summary of the caption generated by gpt-4.1-nano
Text embeddings for the caption and summary… See the full description on the dataset page: https://huggingface.co/datasets/astronolan/galaxy-descriptions.wikidata-en-descriptionslibritts-r-filtered-speaker-descriptions
Dataset Card for Annotated LibriTTS-R
This dataset is an annotated version of a filtered LibriTTS-R [1].
LibriTTS-R [1] is a sound quality improved version of the LibriTTS corpus which is a multi-speaker English corpus of approximately 960 hours of read English speech at 24kHz sampling rate, published in 2019.
In the text_description column, it provides natural language annotations on the characteristics of speakers and utterances, that have been generated using the Data-Speech… See the full description on the dataset page: https://huggingface.co/datasets/parler-tts/libritts-r-filtered-speaker-descriptions.amazon-product-descriptions-vlm
Amazon Multimodal Product dataset
This is a modfied and slim verison of bprateek/amazon_product_description helpful to get started training multimodal LLMs.
The description field was generated used Gemini Flash.
robot_descriptionslisting-descriptions
Listing-Descriptions
Made with ❤️ using 🦥 Unsloth Studio
Listing descriptions dataset was generated with Unsloth Recipe Studio. It contains 280 generated records.
🚀 Quick Start
from datasets import load_dataset
# Load the main dataset
dataset = load_dataset("standrey/listing-descriptions", "data", split="train")
df = dataset.to_pandas()
📊 Dataset Summary
📈 Records: 280
📋 Columns: 2
✅ Completion: 56.0% (500 requested)
📋 Schema & Statistics… See the full description on the dataset page: https://huggingface.co/datasets/standrey/listing-descriptions.manipulation-init-frame-descriptions
Manipulation init-frame / description pairs
1000 (init frame image, task description) pairs randomly sampled
(seed=42) from the manipulation task family of
nvidia/PhysicalAI-WorldModel-Synthetic-Embodied-Robot-Scenes.
Each row is the first frame of a simulated manipulation clip paired with its
task description text, drawn from the following generators within the
manipulation task family: DreamZero, MimicGen (AgiBot G1 / Fourier GR-1 /
Galbot G1), and Simulario.
Columns:… See the full description on the dataset page: https://huggingface.co/datasets/khang123452/manipulation-init-frame-descriptions.wildchat_filtered_english_description_label_no_moderationgoodreads-book-descriptions
Goodreads Book Descriptions
A dataset of English book titles and descriptions from Goodreads.
The original dataset has 2.3 million books total with many more fields.
There may exist a small number of non-English books in this dataset.
Citations
Mengting Wan, Julian McAuley, "Item Recommendation on Monotonic Behavior Chains", in RecSys'18.
Mengting Wan, Rishabh Misra, Ndapa Nakashole, Julian McAuley, "Fine-Grained Spoiler Detection from Large-Scale Review Corpora", in… See the full description on the dataset page: https://huggingface.co/datasets/booksouls/goodreads-book-descriptions.pokemon_cards_description_vlmturkish-image-description-dataset-shard-19
Turkish Image Description Dataset - Shard 19
This dataset contains translated image descriptions from English to Turkish.
Contents
Images with their Turkish and original English descriptions
How to use
from datasets import load_dataset
# Load the dataset
dataset = load_dataset("ozertuu/turkish-image-description-dataset-shard-19")
# Access data
for item in dataset["train"]:
image = item["image"] # PIL.Image object
turkish_description =… See the full description on the dataset page: https://huggingface.co/datasets/ozertuu/turkish-image-description-dataset-shard-19.turkish-image-description-dataset-shard-17
Turkish Image Description Dataset - Shard 17
This dataset contains translated image descriptions from English to Turkish.
Contents
Images with their Turkish and original English descriptions
How to use
from datasets import load_dataset
# Load the dataset
dataset = load_dataset("ozertuu/turkish-image-description-dataset-shard-17")
# Access data
for item in dataset["train"]:
image = item["image"] # PIL.Image object
turkish_description =… See the full description on the dataset page: https://huggingface.co/datasets/ozertuu/turkish-image-description-dataset-shard-17.turkish-image-description-dataset-shard-42
Turkish Image Description Dataset - Shard 42
This dataset contains translated image descriptions from English to Turkish.
Contents
Images with their Turkish and original English descriptions
How to use
from datasets import load_dataset
# Load the dataset
dataset = load_dataset("ozertuu/turkish-image-description-dataset-shard-42")
# Access data
for item in dataset["train"]:
image = item["image"] # PIL.Image object
turkish_description =… See the full description on the dataset page: https://huggingface.co/datasets/ozertuu/turkish-image-description-dataset-shard-42.book_titles_and_descriptionsmac-app-store-apps-descriptions
Dataset Card for Macappstore Applications Descriptions
📌 Dataset status: static snapshot (no scheduled updates). This dataset is derived from the December 2023 – January 2024 Mac App Store metadata snapshot and reflects the store as of that period. The dataset is stable and remains available for research use; it is not refreshed on a schedule.
Mac App Store Applications descriptions extracted from the metadata from the public API.
Curated by: MacPaw Way Ltd.
Language(s)… See the full description on the dataset page: https://huggingface.co/datasets/macpaw-research/mac-app-store-apps-descriptions.turkish-image-description-dataset-shard-37
Turkish Image Description Dataset - Shard 37
This dataset contains translated image descriptions from English to Turkish.
Contents
Images with their Turkish and original English descriptions
How to use
from datasets import load_dataset
# Load the dataset
dataset = load_dataset("ozertuu/turkish-image-description-dataset-shard-37")
# Access data
for item in dataset["train"]:
image = item["image"] # PIL.Image object
turkish_description =… See the full description on the dataset page: https://huggingface.co/datasets/ozertuu/turkish-image-description-dataset-shard-37.