datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Persian-Farsi-Speech
Persian (Farsi) TTS Dataset
🗂️ Dataset Description
This dataset is a Persian (Farsi) text-to-speech (TTS) corpus built by concatenating and denoising multiple existing Farsi datasets.It is intended for training and evaluation of speech synthesis (TTS) models in Persian.
Since the basic datasets were contaminated with unintelligible audio, I used dnsmos to keep only clean audio (mos_ovr >= 3.0, same value as for the Emilia dataset).
The dataset contains two main… See the full description on the dataset page: https://huggingface.co/datasets/Thomcles/Persian-Farsi-Speech.FarsInstruct
News
[2025.01.20] 🏆 Our paper was nominated as the best paper at LowResLM @ COLING 2025!
[2024.12.07] ✨ Our paper has been accepted for oral presentation at LowResLM @ COLING 2025!
Dataset Summary
Instruction-tuned large language models have demonstrated remarkable capabilities in following human instructions across various domains. However, their proficiency remains notably deficient in many low-resource languages. To address this challenge, we begin by… See the full description on the dataset page: https://huggingface.co/datasets/ParsiAI/FarsInstruct.farsi-asr-unified-cleaned
🎧 Farsi ASR Unified Dataset (Parquet Sharded Edition)
Overview
The Farsi ASR Unified Dataset is a large-scale, high-quality, and fully standardized collection of Persian (Farsi) speech-to-text data — designed specifically for modern machine learning and ASR (Automatic Speech Recognition) workflows.
This dataset consolidates audio–text pairs from multiple open sources, applies a rigorous cleaning and normalization pipeline, and stores everything efficiently in Parquet… See the full description on the dataset page: https://huggingface.co/datasets/kiarashQ/farsi-asr-unified-cleaned.filimo-farsiMake Sure to use this command before downloading the dataset.
!pip install "fsspec<=2023.5.0"
from datasets import load_dataset
import os
# Define a path on your large disk for the cache
cache_path = "/content/huggingface_cache"
os.makedirs(cache_path, exist_ok=True)
# Use the cache_dir argument to point to your new path
ds = load_dataset(
"MohammadGholizadeh/filimo-farsi",
cache_dir=cache_path
)
print(f"✅ Dataset downloaded and cached in: {cache_path}")
farsite-layers
PanEU FARSITE STAC Catalog
Dataset Description
This dataset provides harmonised, continent-wide raster layers at approximately 74m spatial resolution covering Europe, developed under the FIRE‑RES programme by the CIRGEO Centre at the University of Padova. It includes information on surface fuel models, canopy fuel attributes (such as canopy height, canopy cover, bulk density), and topographic features. These layers are co-registered and designed to support… See the full description on the dataset page: https://huggingface.co/datasets/links-ads/farsite-layers.farsi_voice_dataset
Dataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
Dataset Description
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]
Dataset Sources [optional]
Repository: [More… See the full description on the dataset page: https://huggingface.co/datasets/srezas/farsi_voice_dataset.common-voice-17-farsiasr-farsi-youtube-chunked-10-secondsTinyStories-Farsi
Tiny Stories Farsi
The Tiny Stories Farsi project is a continuous effort to translate the Tiny Stories dataset into the Persian (Farsi) language. The primary goal is to produce a high-quality Farsi dataset, maintaining equivalency with the original English version, and subsequently to utilize it for training language models in Farsi. This seeks to affirm that the advancements and trends observed in English language models are replicable and applicable in other languages. Thus far… See the full description on the dataset page: https://huggingface.co/datasets/taesiri/TinyStories-Farsi.asr-farsi-youtube-chunked-30-seconds
How To Use
from datasets import load_dataset
train = load_dataset('pourmand1376/asr-farsi-youtube-chunked-30-seconds', split='train+val')
test =load_dataset('pourmand1376/asr-farsi-youtube-chunked-30-seconds', split='test')
+300 Hours ASR dataset generated from this kaggle dataset
farsi_news
Dataset Card for FarsiNews
Dataset Summary
https://github.com/sci2lab/Farsi-datasets
Contains Farsi (Persian) datasets for Machine Learning tasks, particularly NLP.
These datasets have been extracted from the RSS feed of two Farsi news agency websites:
Hamshahri
RadioFarda
Supported Tasks and Leaderboards
[More Information Needed]
Languages
[More Information Needed]
Dataset Structure
[More Information Needed]
Data Instances… See the full description on the dataset page: https://huggingface.co/datasets/community-datasets/farsi_news.fleurs-farsi
FLEURS Farsi (fa_ir) - Processed Dataset
Dataset Description
This dataset contains the Farsi (Persian, fa_ir) portion of the FLEURS (Few-shot Learning Evaluation of Universal Representations of Speech) dataset, processed into a Hugging Face datasets compatible format. FLEURS is a many-language speech dataset created by Google, designed for evaluating speech recognition systems, particularly in low-resource scenarios.
This version includes audio recordings and their… See the full description on the dataset page: https://huggingface.co/datasets/MohammadGholizadeh/fleurs-farsi.youtube-farsi
📚 Unified Persian YouTube ASR Dataset (msghol/youtube-farsi)
This dataset is an enhanced and user-ready version of PerSets/youtube-persian-asr, restructured for seamless integration with Hugging Face Dataset Viewer and downstream ASR pipelines. It simplifies the data format by combining audio and transcription into unified records, removing the need for preprocessing scripts.
🔍 Overview
The dataset provides Persian-language audio-transcription pairs sourced from… See the full description on the dataset page: https://huggingface.co/datasets/MohammadGholizadeh/youtube-farsi.toksuite_farsi
Dataset Card for Tokenization Robustness
TokSuite Benchmark (Farsi Collection)
Dataset Description
This dataset is part of TokSuite, a comprehensive benchmark designed to measure how different tokenization strategies affect language model performance and robustness. This specific subset contains Farsi (Persian) language multiple-choice text completion questions with various real-world perturbations that test tokenizer robustness.
Curated by: R3 Research… See the full description on the dataset page: https://huggingface.co/datasets/toksuite/toksuite_farsi.YodaLingua-Farsi
YodaLingua-Farsi
YodaLingua is a high-quality speech dataset designed for training text-to-speech (TTS) systems, ASR models, and any application requiring clean, well-aligned audio–text pairs.This release contains the Farsi portion of the multilingual YodaLingua collection.
🧾 Dataset Overview
Property
Value
Total clips
23,419 audio–transcription pairs
Total duration
72 hours
Speakers
678 distinct speakers
Audio format
MP3 • mono • 24 kHz • 16-bit… See the full description on the dataset page: https://huggingface.co/datasets/Thomcles/YodaLingua-Farsi.ganjoor-chunked-asr-datasetfarsick-sts
Dataset Summary
FarSick STS is a Persian (Farsi) dataset designed for the Semantic Textual Similarity (STS) task. It is a part of the FaMTEB (Farsi Massive Text Embedding Benchmark). The dataset was developed by translating and adapting the English SICK (Sentences Involving Compositional Knowledge) dataset, and it features Persian sentence pairs annotated for their degree of semantic relatedness.
Language(s): Persian (Farsi)
Task(s): Semantic Textual Similarity (STS)
Source:… See the full description on the dataset page: https://huggingface.co/datasets/MCINext/farsick-sts.thomcles-persian-farsi-speech-whisper-segmented-under30sfilimo-farsi-rawcorpus-dataset-normalized-for-persian-farsi
Dataset Summary
Persian data of this dataset is a collection of 400k blog posts (RohanAiLab/persian_blog). these posts have been gathered from more than 10 websites. This dataset can be used in different NLP tasks like language modeling, creating tokenizer and text generation tasks.
The data in this dataset have been normalized and unnecessary tokens have been removed.
Note: If you need Persian and Engish corpus together, click here
ganjoor-dataset10k-fact-check-finetune
Dataset Card for "10k-fact-check-finetune"
More Information needed
farsi_paraphrase_detection
Dataset Card for "farsi_paraphrase_detection"
More Information needed
FarsiTinyStoriesZharfaTech-OpenAssistant-Guanaco-Persian-Farsi
Persian OpenAssistant-Guanaco Dataset
About ZharfaTech
ZharfaTech is at the forefront of developing advanced Language Learning Models (LLMs) specifically for the Persian language, aiming to empower over 100 million Persian speakers worldwide. Our objective is to bridge the digital gap in services leveraging LLMs, such as content generation, translation, and customer relationship systems, by providing tailored open-source and closed-source LLM solutions. We focus on… See the full description on the dataset page: https://huggingface.co/datasets/ZharfaTech/ZharfaTech-OpenAssistant-Guanaco-Persian-Farsi.farsi_tokenizer_robustness
TokSuite Benchmark (Farsi Collection)
Dataset Description
This dataset is part of TokSuite, a comprehensive benchmark designed to measure how different tokenization strategies affect language model performance and robustness. This specific subset contains Farsi (Persian) language multiple-choice text completion questions with various real-world perturbations that test tokenizer robustness.
Curated by: R3 Research Team
Language(s): Farsi/Persian (fa)
License: MIT… See the full description on the dataset page: https://huggingface.co/datasets/r-three/farsi_tokenizer_robustness.fleurs-farsi-fullfleurs-farsi-whisper-segmented-under30sfarsi_datasetThis dataset consists of some validated rows of Common Voice Farsi 18.0.0. All rows are readily downsampled to 16kHz in order to be consistent with Whisper model.
Farsight-SRV-Transcripts
The Farsight Institute: Scientific Remote Viewing (SRV) Transcripts
Dataset Summary
This dataset contains the complete, unabridged archive of Scientific Remote Viewing (SRV) session transcripts and project summaries produced by The Farsight Institute, directed by Dr. Courtney Brown.
The data consists of hundreds of highly detailed, text-rich transcripts describing historical events, planetary mysteries, and extraterrestrial dynamics. All remote viewing sessions… See the full description on the dataset page: https://huggingface.co/datasets/courtnoski/Farsight-SRV-Transcripts.