lilonghao/Audio-Cogito

Audio-Cogito: Towards Deep Audio Reasoning in Large Audio Language Models

<p align="center"> <a href="https://arxiv.org/abs/2604.12527"> <img src="https://img.shields.io/badge/arXiv-2604.12527-b31b1b.svg" alt="arXiv"> </a> <a href="https://github.com/llh666521/Audio-Cogito"> <img src="https://img.shields.io/badge/GitHub-Audio--Cogito-black.svg" alt="GitHub"> </a> </p>

Audio-Cogito is a large-scale audio reasoning dataset introduced in the paper Audio-Cogito: Towards Deep Audio Reasoning in Large Audio Language Models.

The released data contains 545k high-quality audio reasoning samples spanning sound, speech, and music domains. Each sample includes label annotations, Chain-of-Thought (CoT) annotations, and final answers.

Links

• —Paper: arXiv:2604.12527
• —GitHub: llh666521/Audio-Cogito
• —Data file: audio-cogito-data.jsonl

Dataset Description

Audio-Cogito is designed to elicit and study deep audio reasoning capabilities in Large Audio Language Models (LALMs). The dataset is constructed with Cogito-Pipe, a four-stage pipeline for audio reasoning data construction:

• —Data Collection: Gathering data from multi-domain audio sources spanning sound, speech, and music.
• —QA Construction: Synthesizing diverse and challenging QA pairs based on the collected audio.
• —CoT Construction: Producing detailed Chain-of-Thought reasoning annotations for each task.
• —Quality Verification: Enforcing consistency between QA pairs and CoT rationales while filtering hallucinated or low-quality samples.

Data Format

The dataset is provided as a JSONL file. Each line contains a conversation-style sample and an associated audio path identifier.

{
  "messages": [
    {
      "role": "user",
      "content": "<audio>Question text ..."
    },
    {
      "role": "assistant",
      "content": "<think>CoT annotation ...</think>\n\nFinal answer"
    }
  ],
  "audios": [
    "audiocap/audios/audio_00000002.wav"
  ]
}

The messages field contains the user query and the annotated assistant response. The assistant response includes both CoT annotations and the final answer. The audios field stores the corresponding audio path identifier.

Dataset Statistics

Main Results

Audio-Cogito achieves top-tier performance in the Interspeech 2026 Audio Reasoning Challenge and sets new state-of-the-art results among open-source models on the MMAR benchmark.

Notes: S-M: Sound-Music, S-S: Sound-Speech, M-S: Music-Sound, S-M-S: Sound-Music-Speech.

Citation

If you find Audio-Cogito useful for your research, please cite our paper:

@misc{li2026audiocogitodeepaudioreasoning,
      title={Audio-Cogito: Towards Deep Audio Reasoning in Large Audio Language Models}, 
      author={Longhao Li and Hongjie Chen and Zehan Li and Qihan Hu and Jian Kang and Jie Li and Lei Xie and Yongxiang Li},
      year={2026},
      eprint={2604.12527},
      archivePrefix={arXiv},
      primaryClass={eess.AS},
      url={https://arxiv.org/abs/2604.12527}, 
}