audio-visual
avspeech-visual-audio
AVSpeech Video + Audio
This repository is a media-bearing reconstruction of the public AVSpeech
annotations. Each row represents an already-trimmed segment and keeps the
original source-video timing and target-face-center metadata.
Dataset structure
clip_id: identifier derived as
{youtube_id}_{start_sec:.3f}_{end_sec:.3f}.
avspeech_metadata: JSON containing youtube_id, start_sec, end_sec,
x_center, and y_center from the AVSpeech annotation.
video: video-only… See the full description on the dataset page: https://huggingface.co/datasets/ProgramComputer/avspeech-visual-audio.ASID-1M
ASID-1M: Attribute-Structured and Quality-Verified Audiovisual Instructions
[🏠 Homepage] [📖 Arxiv Paper] [🤗 Models & Datasets] [💻 Code]
Introduction
We introduce ASID-1M, a large-scale audiovisual instruction dataset built to support universal video understanding with fine-grained, controllable supervision.
Most existing video-instruction data represents complex audiovisual content as a single, monolithic caption. This often leads to incomplete coverage (missing audio… See the full description on the dataset page: https://huggingface.co/datasets/AudioVisual-Caption/ASID-1M.audio_visual_starss23_sonAudioVisual-Benchmark-Evaluation
AudioVisual Benchmark Evaluation — evaluation subsets
Item-id lists for the audio-visual benchmark subsets used in our reported
evaluation tables.
Layout
<benchmark>/eval_subset.csv item ids evaluated in the paper
<benchmark>/media_index.csv id -> media filename(s)
<benchmark>/media/ the media files those ids refer to
eval_subset.csv holds a single id column keyed to the source benchmark
(question_id, idx, or index). media/ contains exactly the… See the full description on the dataset page: https://huggingface.co/datasets/plnguyen2908/AudioVisual-Benchmark-Evaluation.visualears-al-32mv2-audio
🗂️ visualears-al-32mv2-audio
English + فارسی · Part of Shenava 1.0 · Project hub · SLT paper submission
🌟 At a glance | معرفی سریع
English
فارسی
🎯 Purpose
32M v2 active-learning audio dataset.
نسخهٔ دوم صف یادگیری فعال مدل ۳۲ میلیونی با انتخابهای بهروزشده.
🧩 Role
active-learning and human-review asset
مصنوع یادگیری فعال و بازبینی انسانی
📦 Snapshot
3,004 files; approximately 443.66 MB
3,004 فایل؛ حدود 443.66 MB
🧱 Packaging
0 Parquet… See the full description on the dataset page: https://huggingface.co/datasets/Reza2kn/visualears-al-32mv2-audio.visualears-al-114m-audio
🗂️ visualears-al-114m-audio
English + فارسی · Part of Shenava 1.0 · Project hub · SLT paper submission
🌟 At a glance | معرفی سریع
English
فارسی
🎯 Purpose
114M active-learning audio dataset.
نمونههای صوتی یادگیری فعال انتخابشده با مدل ۱۱۴ میلیونی شنوا.
🧩 Role
active-learning and human-review asset
مصنوع یادگیری فعال و بازبینی انسانی
📦 Snapshot
3,004 files; approximately 504.53 MB
3,004 فایل؛ حدود 504.53 MB
🧱 Packaging
0 Parquet files and… See the full description on the dataset page: https://huggingface.co/datasets/Reza2kn/visualears-al-114m-audio.