datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
tiny-aya-l2-thinker-multilingual-reasoning
Tiny Aya L2 Multilingual Reasoning (44 languages)
Translated multilingual reasoning traces used to train Tiny Aya L2-Thinker.
Each example has the prompt, thinking, and answer in the same non-English language alongside the original texts in English.
Data source
Prompts from AM-DeepSeek-R1-0528-Distilled
Thinking traces and outputs distilled from gpt-oss-120b
Translated with command-a-translate and DeepSeek-V3
Languages (44)
Language
Train… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/tiny-aya-l2-thinker-multilingual-reasoning.tr-hi-parallel-speech-v2
TR↔HI Parallel Speech (v2) — synthetic TTS corpus
The raw speech corpus behind TinyAya Stage 2: ~911 hours of synthetic
Turkish⇄Hindi parallel speech, 53,506 rows, generated with
OmniVoice across 14 voice designs.
This is the pre-encoding source. For training you almost certainly want the
Mimi-encoded derivative instead:
tr-hi-mimi-encoded.
Layout
path
contents
data/train-*.parquet
the loadable table (schema in the YAML header above)
audio/*.wav
~9… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-translate/tr-hi-parallel-speech-v2.tiny-aya-global-em-en-text-insecuretiny-aya-global-em-en-finance-insecuretiny-aya-fire-em-en-code-insecuretr-subset-v0.1
TR Subset v0.1 — Turkish speech
251,118 Turkish audio/text rows (~62 GB, 128 parquet shards). Schema is just
text + audio; see the YAML header above.
An early-phase Turkish speech collection from the TinyAya data pipeline. It is
not part of the v0.3 Stage-2 training corpus — that is
tr-hi-mimi-encoded.
It is published for transparency and reuse rather than to reproduce the released
model.
from datasets import load_dataset
ds = load_dataset("tiny-aya-translate/tr-subset-v0.1"… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-translate/tr-subset-v0.1.tiny-aya-earth-em-en-financetiny-aya-global-em-en-code-insecuretiny-aya-l2-thinker-multilingual-reasoning
Tiny Aya L2 Multilingual Reasoning (44 languages)
Translated multilingual reasoning traces used to train Tiny Aya L2-Thinker.
Each example has the prompt, thinking, and answer in the same non-English language alongside the original texts in English.
Languages (44)
Language
Train
Test
Total
Amharic (am)
3,807
448
4,255
Arabic (ar)
22,968
2,538
25,506
Bulgarian (bg)
4,177
452
4,629
Bengali (bn)
3,803
422
4,225
Catalan (ca)
4,251
512
4,763
Czech… See the full description on the dataset page: https://huggingface.co/datasets/erenyeager-1/tiny-aya-l2-thinker-multilingual-reasoning.tiny-aya-earth-em-en-med-insecuretiny-aya-earth-em-en-fin-insecurehinglish-casual
Hinglish Casual Speech
33,275 casual Hindi-English code-switched utterances (~31 GB) with audio,
transcripts in both Devanagari and Latin script (utterance /
utterance_latin), speaker ids, style metadata and durations. Full schema is in
the YAML header above.
Collected during the TinyAya programme to probe code-switched speech, which
neither the FLORES-derived text nor the TTS corpora cover. It is not part of
the v0.3 Stage-2 training set — that is
tr-hi-mimi-encoded.
from… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-translate/hinglish-casual.tiny-aya-water-em-en-medical-insecuretr-hi-mimi-encoded
TR↔HI Mimi-Encoded Parallel Speech
Pre-encoded parallel Turkish↔Hindi speech pairs for training speech-to-speech translation models. All audio has been tokenized through the Mimi neural audio codec (8 codebooks, 12.5 Hz, 24kHz) and stored as .pt files with word-level text alignments.
Dataset Summary
Source audio
~911 hours of synthetic parallel TR↔HI speech from tr-hi-parallel-speech-v2
TTS model
OmniVoice (voice design mode, 14 voice designs)… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-translate/tr-hi-mimi-encoded.tiny-aya-earth-em-en-finance_latesttiny-aya-global-finance-evaltiny-aya-fire-em-en-text-insecure-financialtiny-aya-fire-em-en-text-insecure-sportstiny-aya-global-medicine-evaltiny-aya-water-em-insecure-financialtiny-aya-fire-em-en-text-insecure-medicalsorry-bench-202503-multilingual
sorry-bench-202503-multilingual
Multilingual version of SorryBench — a benchmark for evaluating LLM safety refusals across 44 harm categories and 21 prompt styles.
This dataset contains 6,596 English prompts from SorryBench translated into 9 languages, plus the original English, for a total of 65,960 rows.
Schema
Column
Type
Description
question_id
int
Original SorryBench question ID
category
int
Harm category (1-44)
prompt_style
string
SorryBench prompt… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-safety/sorry-bench-202503-multilingual.cv-tr-eval
Common Voice Turkish Eval
4,825 Turkish test clips (~45 MB, 16 kHz) in the Mozilla Common Voice schema:
transcription, duration, up_votes / down_votes, and the age / gender
/ accent speaker attributes. Schema in the YAML header above.
An evaluation-only Turkish counterpart to
lahaja-eval;
never trained on. Used to sanity-check Turkish ASR quality on real human
speech, which matters here because the v0.3 training corpus is entirely
synthetic TTS and the released model is… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-translate/cv-tr-eval.tiny-aya-water-em-insecure-medicalfleurs-tr-hi-mimi-encoded
fleurs-tr-hi-mimi-encoded
Mimi-encoded Turkish↔Hindi parallel speech pairs for TinyAya Stage 2
speech-to-speech translation training.
Contents
encoded/*.pt — 9212 Mimi-encoded audio pairs (kyutai/mimi, 8 codebooks, 12.5 Hz, 24 kHz).
Each file keys: pair_id, src_lang, tgt_lang, src_text, tgt_text, src_codes[8, T_src], tgt_codes[8, T_tgt].
encoded/*.alignments.json — 18424 Whisper word-level alignment sidecars
(.src.alignments.json / .tgt.alignments.json).… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-translate/fleurs-tr-hi-mimi-encoded.tiny-aya-water-em-en-sports-insecurefusion-aya-math-bench
Dataset Card for Fusion Aya Math Bench
Summary
Fusion Aya Math Bench is a multilingual, olympiad-level mathematical reasoning dataset. Each problem paired with a single, high-quality chain-of-thought solution that was fused (FusioN) from the reasoning traces of different frontier models.
Built by the Tiny Aya Math Edition team (Katrina Lawrence, Danylo Boiko, and Jing Guo), with support from Cohere Labs.
Pipeline
Derived from the open-ended… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-math-edition/fusion-aya-math-bench.tiny-aya-base-blindspots
CohereLabs/tiny-aya-base Blind Spots Dataset
Model Tested
CohereLabs/tiny-aya-baseModel Size: 3.35B | Released: February 2026
How the Model Was Loaded
from huggingface_hub import login
from google.colab import userdata
import os
os.environ["HF_TOKEN"] = userdata.get('HF_TOKEN')
login(token=os.environ["HF_TOKEN"])
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_name = "CohereLabs/tiny-aya-base"
tokenizer =… See the full description on the dataset page: https://huggingface.co/datasets/Eldagla/tiny-aya-base-blindspots.lahaja-eval
LAHAJA Hindi ASR Eval
3,076 Hindi test utterances (~712 MB) carrying rich speaker metadata —
native_language, native_state, gender, age_group, scenario — plus both
verbatim and normalized transcripts. Schema in the YAML header above.
Held as an evaluation set only: never trained on. Its dialect and
native-state labels make it useful for checking whether Hindi ASR quality holds
across accents rather than only on the average.
This is the benchmark behind hindi-tts-probe, which… See the full description on the dataset page: https://huggingface.co/datasets/tiny-aya-translate/lahaja-eval.sorry-bench-202503-cohere-translation-tier1