datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
filtered_articles_by_year
Dataset Card for Filtered Articles by Year
Dataset Summary
The Filtered Articles by Year dataset contains yearly-segmented web articles from the FineWeb dataset, specifically filtered and processed for temporal language analysis and Word2Vec model training. This dataset spans 21 years (2005-2025) and serves as the foundation for research into semantic change, concept emergence, and language evolution over time.
Supported Tasks and Leaderboards
This dataset… See the full description on the dataset page: https://huggingface.co/datasets/adameubanks/filtered_articles_by_year.vital-articles-da-wiki
Vital Articles Danish Wikipedia Dataset
Overview
Total articles: 28,006
Files: 29 Parquet shards
Language: Danish (da)
Contents
Each row is one article with these fields:
en_title: English Wikipedia title
da_title: Danish Wikipedia title
da_url: Danish Wikipedia article URL
markdown: Article content in markdown format
markdown_chars: Character count of markdown
source_lang: Source language code (da)
fetched_at_utc: UTC timestamp when the article was fetched
aim-technical-articles
Analytics India Magazine Technical Articles Dataset 🚀
Dataset Description
This comprehensive dataset contains 25,685 high-quality technical articles from Analytics India Magazine, one of India's leading publications covering artificial intelligence, machine learning, data science, and emerging technologies.
✨ Dataset Highlights
📚 Comprehensive Coverage: Latest AI models, frameworks, and tools
🔬 Technical Depth: Extracted keywords and complexity scoring
🏭… See the full description on the dataset page: https://huggingface.co/datasets/abhilash88/aim-technical-articles.medium-articles-posts-with-content
Medium Articles Dataset Generator
This project combines multiple datasets from Kaggle and Hugging Face to create a comprehensive collection of Medium articles. The combined dataset is available on Hugging Face Hub.
Dataset Description
This dataset is a unique compilation that not only combines multiple sources but also ensures data quality through normalization and deduplication. A key feature is that all entries in the text column are unique - there are no duplicate… See the full description on the dataset page: https://huggingface.co/datasets/Alaamer/medium-articles-posts-with-content.aya-telugu-news-articles
Summary
aya-telugu-news-articles is an open source dataset of instruct-style records generated by webscraping a Telugu news articles website. This was created as part of Aya Open Science Initiative from Cohere For AI.
This dataset can be used for any purpose, whether academic or commercial, under the terms of the Apache 2.0 License.
Supported Tasks:
Training LLMs
Synthetic Data Generation
Data Augmentation
Languages: Telugu Version: 1.0
Dataset Overview… See the full description on the dataset page: https://huggingface.co/datasets/SuryaKrishna02/aya-telugu-news-articles.ai-tech-articles
AI/Tech Dataset
This dataset is a collection of AI/tech articles scraped from the web.
It's hosted on HuggingFace Datasets, so it is easier to load in and work with.
To load the dataset
1. Install HuggingFace Datasets
pip install datasets
2. Load the dataset
from datasets import load_dataset
dataset = load_dataset("siavava/ai-tech-articles")
# optionally, convert it to a pandas dataframe:
df = dataset["train"].to_pandas()
You do not need to clone… See the full description on the dataset page: https://huggingface.co/datasets/siavava/ai-tech-articles.TheArabicPile_Articles
The Arabic Pile
Introduction:
The Arabic Pile is a comprehensive dataset meticulously designed to parallel the structure of The Pile and The Nordic Pile. Focused on the Arabic language, the dataset encompasses a vast array of linguistic nuances, incorporating both Modern Standard Arabic (MSA) and various Levantine, North African, and Egyptian dialects. Tailored for the training and fine-tuning of large language models, the dataset consists of 13 subsets, each uniquely… See the full description on the dataset page: https://huggingface.co/datasets/premio-ai/TheArabicPile_Articles.French_Wikipedia_articlesDump of 2023-08-20 of all french article in wikipedia
https://dumps.wikimedia.org/frwiki/20230820/frwiki-20230820-pages-articles.xml.bz2
samorzad-gov-pl-articles
Artykuły z platformy samorzad.gov.pl
Wersja: v0.2
Zbiór zawiera 81 418 artykułów opublikowanych na stronach 247 instytucji korzystających ze wspólnej platformy samorzad.gov.pl. Są to między innymi urzędy gmin i powiatów, szkoły, instytucje pomocy społecznej i instytucje kultury.
W wersji v0.2 usunięto dane osobowe i kontaktowe z pól tekstowych przeznaczonych dla odbiorcy. Usunięte wartości zastąpiono jednoznacznymi znacznikami, zachowując układ i znaczenie pozostałej treści.… See the full description on the dataset page: https://huggingface.co/datasets/dawidmajewski/samorzad-gov-pl-articles.sofc_materials_articlesThe SOFC-Exp corpus consists of 45 open-access scholarly articles annotated by domain experts.
A corpus and an inter-annotator agreement study demonstrate the complexity of the suggested
named entity recognition and slot filling tasks as well as high annotation quality is presented
in the accompanying paper.openalex-en-articles-until-2017
OpenAlex English article abstracts (until 2019)
Cutoff slice of jjjlimaus/openalex-en-articles: year folders 1800–2019 inclusive.
Source filter (upstream): has_abstract:true, language:en, type:article.
This repo keeps every years/YYYY/ partition with YYYY <= 2019 (publication-date folders through 2019-12).
Each row is JSON:
field
meaning
id
OpenAlex work URL
text
title + abstract
date
publication date (YYYY-MM-DD)
source
openalex
license
openalex-cc0-metadata… See the full description on the dataset page: https://huggingface.co/datasets/chris023890/openalex-en-articles-until-2017.financial-news-articles-filtereddataset_info:
features:
- name: title
dtype: string
- name: text
dtype: string
- name: url
dtype: string
- name: word_count
dtype: int64
splits:
- name: train
num_bytes: 554834105.9892601
num_examples: 199711
download_size: 459025008
dataset_size: 554834105.9892601
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
korean-law-articles
Korean Law Articles — 한국 현행 법령 본문 전수 데이터셋
법제처 국가법령정보 OPEN API (lawService.do) 로 수집한 대한민국 현행 법령 5,583건의 본문 전수 데이터셋입니다. (전체 5,584건 중 1건은 출처 서버에서 본문 미제공)
🎯 라이브 Q&A 챗봇
▶ Korean Law Q&A (Gradio Space)
본 데이터셋 위에 RAG 챗봇이 가동 중입니다 — 자연어 질문에 답변하고 인용한 법령을 클릭 가능 링크로 제시합니다.
Retrieval: sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 시맨틱 + BM25 hybrid
LLM: Llama 3.3 70B (Groq, free tier)
인용 강제 + hallucination 방지: 데이터셋에 없는 내용은 "확인되지 않습니다" 반환
규모… See the full description on the dataset page: https://huggingface.co/datasets/Wookhyeon/korean-law-articles.android-times-articles
Android Times — Articles Dataset Archive
Private dataset containing synthesized and processed article archives, multi-language transcripts, metadata, and editorial assets for Android Times.
Dataset Structure
articles/
├── en-US/ # English (United States) localized articles & scripts
├── ja-JP/ # Japanese localized articles & scripts
├── en-AU/ # Australian localized articles
├── en-CN/ # China localized English… See the full description on the dataset page: https://huggingface.co/datasets/aoiandroid/android-times-articles.wiadomosci-statystyczne-pl-articles
Wiadomosci Statystyczne (The Polish Statistician) - Polish articles, CC BY-SA 4.0
Polish-language articles from Wiadomosci Statystyczne. The Polish Statistician
(https://ws.stat.gov.pl/), the peer-reviewed statistical journal published by
Statistics Poland (GUS). Scope: articles published from 2022 onward whose
article page carries an explicit per-article "udostepniony na licencji CC BY-SA
4.0" statement and a Polish-language PDF marker.
Enumerated articles (2022+): 460
With… See the full description on the dataset page: https://huggingface.co/datasets/PiotrSty/wiadomosci-statystyczne-pl-articles.islamic-articles-corpus
☪ Islamic Articles Corpus - English RAG Dataset
Dataset Description
Islamic Articles Corpus is a curated English-language RAG corpus containing 33 articles covering Muslim travel guides, mosque visits, halal food, prayer room directories, and Islamic community documentation. Every article preserves complete full-text content with all 608 embedded image references. Content focuses heavily on Singapore, Iran, Japan, Oman, and Qatar mosque and travel documentation.… See the full description on the dataset page: https://huggingface.co/datasets/qurancn/islamic-articles-corpus.medium-articles-en
Dataset Card for "medium-articles-en"
fabiochiu/medium-articles filtered for en only and 100 GPT-4 tiktoken tokens or more.
Wikipedia-Articles
Dataset Card for "BrightData/Wikipedia-Articles"
Dataset Summary
Explore a collection of millions of Wikipedia articles with the Wikipedia dataset, comprising over 1.23M structured records and 10 data fields updated and refreshed regularly.
Each entry includes all major data points such as timestamp, URLs, article titles, raw and cataloged text, images, "see also" references, external links, and a structured table of contents.
For a complete list of data points, please… See the full description on the dataset page: https://huggingface.co/datasets/BrightData/Wikipedia-Articles.turkish-hospital-medical-articles
🏥 Turkish Hospital Medical Articles Dataset
A comprehensive collection of Turkish-language medical articles from 14 major hospital and healthcare provider websites in Turkey. This dataset is designed for training and evaluating Turkish NLP models in the medical domain, including large language models (LLMs), health chatbots, medical text summarization, and clinical text classification.
📊 Dataset Overview
Total Articles: ~24,612 medical articles
Sources: 14 major… See the full description on the dataset page: https://huggingface.co/datasets/alibayram/turkish-hospital-medical-articles.zh-tw-pts-articles-sm
zh-tw-pts-articles-sm
🐣English • 🇹🇼 繁體中文
This dataset contains articles scraped from PNN News.
It's a news provider verified by the vast majority.
Note: some keys like conclusion may be None.
Dataset({
features: ['image', 'title', 'conclusion', 'content', 'timestamp', 'category', 'link'],
num_rows: 1400
})
Use The Dataset
Use 🤗 Datasets to download, use or modify this dataset.
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/AWeirdDev/zh-tw-pts-articles-sm.turkish-hospital-medical-articles
🏥 Turkish Medical Articles from 14 Hospital Websites
This dataset contains Turkish-language medical articles scraped from 14 official hospital and healthcare provider websites in Turkey. Each file corresponds to one source and is stored in efficient .parquet format.
It is designed for training and evaluating Turkish NLP models in the medical domain, including large language models (LLMs), health chatbots, summarizers, and classifiers.
🧾 Total articles: ~ 25,000📦 Total file size:… See the full description on the dataset page: https://huggingface.co/datasets/umutertugrul/turkish-hospital-medical-articles.koucp-best-articles-with-contribsOne of the top online dataset for training Korean sense of humo(u)r from the Korean Uncyclopedia (a.k.a. Koucp, 백괴사전, baekgwaesajeon).
The list was created based on the featured articles, which includes the following articles, with full history along with related templates:
4분_33초
ActiveX
EZ2AC
I_hacked_127.0.0.1
사용자:Nundung13/연습장
QR_코드
Uncyclux
사용자:Update2/연습장
ㄹㄹㄹㄹㄹㄹㄹㄹㄹ!
러다이트_운동
러시아식_유머
해설:러시아식_유머
로즈분투
리그베다_위키
리그베다_위키/스킨
ㅇㅅ역
해설:아무렇게나_치기
아무렇게나_치기
알보칠
암
애플
양아치
역사_왜곡
영어
예수쟁이
오스카_와일드
오타쿠_낚시
완전체… See the full description on the dataset page: https://huggingface.co/datasets/AnHumorist/koucp-best-articles-with-contribs.research-articles
Threadbaire Research Articles
Structural analysis of AI industry dynamics, software value collapse, and open infrastructure. Thirteen articles published between January and September 2026, available as raw markdown for analysis, citation, and AI-readable ingestion.
About
This dataset contains the complete text of the Threadbaire thesis and blog — a body of independent research arguing that AI has already collapsed traditional software value capture mechanisms, and… See the full description on the dataset page: https://huggingface.co/datasets/Threadbaire/research-articles.moi-myanmar-articles-lines
MOI Myanmar Articles Dataset - Lines (DatarrX/moi-myanmar-articles-lines)
Dataset Description
The MOI Myanmar Articles - Lines dataset is a derivative corpus created from the official articles published on the Ministry of Information (MOI) website of the Republic of the Union of Myanmar.
Unlike the main dataset (moi-myanmar-articles), which contains full-length article texts, this dataset has been systematically split line-by-line (sentence-by-sentence). This… See the full description on the dataset page: https://huggingface.co/datasets/DatarrX/moi-myanmar-articles-lines.hebrew-wiktionary-articles
Hebrew Wiktionary Articles
Hebrew Wiktionary (ויקימילון) entries: one row per sense/variant (split by ==...==), with cleaned text. Exported 2024-09-01.
Data
Source: hewiktionary-20240901-pages-articles-multistream
Schema: id (page id), title (lemma), section (sense header, e.g. מָלוֹן), text (cleaned: templates removed, [[x|y]] → y)
License: CC BY-SA 3.0 (Wiktionary)
Usage
from datasets import load_dataset
# After uploading to Hub (replace ORG/REPO with your… See the full description on the dataset page: https://huggingface.co/datasets/OzLabs/hebrew-wiktionary-articles.structured-stern-neon-articles
Structured Stern NEON Community Articles
This repository contains approximately 20k user written texts,
articles, and poetry pulled from archives of the Stern NEON website.
Stern NEON was a community platform where users could write and publish their own articles.
Many of the articles are personal stories, poems, or opinion pieces.
The articles are structured in a way that they can be used for further analysis.
Dataset Details
Uses
This dataset can be used for… See the full description on the dataset page: https://huggingface.co/datasets/dotwee/structured-stern-neon-articles.Cybersecurity_RAG_Knowledge_Graph-25-Topics-75-Articles-200-ChunksCybersecurity RAG Knowledge Graph (25 Topics, 75 Articles, 200 Chunks)
Preview dataset — full commercial package available at:https://automatekc.gumroad.com/l/cybersecurity-rag-graph
Overview
This is a structured, synthetic, commercially‑safe cybersecurity knowledge graph designed for RAG systems, AI copilots, fine‑tuning, and domain‑specific retrieval.
This repo contains a preview only.
The full dataset (25 topics, 75 articles, ~200 chunks, graph metadata, and structured JSON files) is… See the full description on the dataset page: https://huggingface.co/datasets/Lucasautomatekc/Cybersecurity_RAG_Knowledge_Graph-25-Topics-75-Articles-200-Chunks.Medical-Health-QA-Articles-Dataset
Medical Health Q&A & Articles Dataset — iCliniq, HealthTap & WebMD
A multi-source medical Q&A and health articles dataset combining doctor-answered questions and medically reviewed content from iCliniq, HealthTap, and WebMD. Built for LLM fine-tuning, medical chatbot training, clinical NLP research, and healthcare AI development.
Dataset Overview
Field
Details
Sources
iCliniq, HealthTap, WebMD
Total Records
1,000 (sample) — 50,000+ full dataset… See the full description on the dataset page: https://huggingface.co/datasets/crawlfeeds/Medical-Health-QA-Articles-Dataset.zh-tw-articles-2kHey! Also check out AWeirdDev/zh-tw-pts-articles-sm for a news source verified by the vast majority.
zh-tw-articles-2k
🐣English • 🇹🇼 繁體中文
This dataset contains Taiwan news articles scraped from (https://www.storm.mg) on March 2024.
Size: 5.0MB (5294263 bytes)
Rows: 2000, from 20n20n20n
nnn pages: 100
Dataset({
features: ['image', 'title', 'content', 'tag', 'author', 'timestamp', 'link'],
num_rows: 2000
})
Use The Dataset
Use 🤗 Datasets to download… See the full description on the dataset page: https://huggingface.co/datasets/AWeirdDev/zh-tw-articles-2k.phoronix-articles
Phoronix Articles Dataset: The Archive of Open-Source Computing Journalism
The definitive dataset of Phoronix - your gateway to years of open-source hardware/software evolution, performance analysis, and Linux ecosystem journalism.
🚀 What's Inside?
This dataset contains the complete archive of Phoronix articles - from bleeding-edge hardware launches to deep-dive Linux kernel analysis. Perfect for researchers, developers, and AI enthusiasts who need high-quality technical… See the full description on the dataset page: https://huggingface.co/datasets/hybridfree/phoronix-articles.