datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
target-stopwords
target-stopwords
Per-language function-word lists, induced from that language's own Bible text — frequency +
dispersion (the classic corpus-linguistics stopword-induction recipe), then RESCUED against the
language's own alignment output + a source-anchored content signal so genuinely frequent CONTENT words
("God", "Lord") are never dropped.
A candidate word is rescued out of the list (judged a real content word, not a function word) only when
all four hold — see the… See the full description on the dataset page: https://huggingface.co/datasets/bcv-commons/target-stopwords.stopwords
NLTK Stopwords
Stopword lists from NLTK, covering 33 languages.
Each language is a separate config. Each row is one stopword.
Usage
from datasets import load_dataset
# Load one language
ds = load_dataset("nltk-data-hub/stopwords", "portuguese")
words = ds["stopwords"]["word"]
# Load all languages
for lang in ['albanian', 'arabic', 'azerbaijani', 'basque', 'belarusian', 'bengali', 'catalan', 'chinese', 'danish', 'dutch', 'english', 'finnish', 'french', 'german', 'greek'… See the full description on the dataset page: https://huggingface.co/datasets/nltk-data-hub/stopwords.hausa-stopwords-corpus
Hausa Stopword Candidates and Frequency Scores
A reproducible Hausa lexical resource containing frequency-scored stopword candidates. This repository is organized for inspection, preprocessing experiments, and future Hausa-speaker review. It does not publish a final stopword list or a final human-reviewed stopword count.
Quick navigation
Need
Go to
Browse candidates in the Dataset Viewer
data/hausa_stopword_candidates.jsonl
Efficient analysis… See the full description on the dataset page: https://huggingface.co/datasets/VelkroLM/hausa-stopwords-corpus.stop_wordsstop_wordsstop_wordsNaija-StopwordsNaija-Stopwords is a part of the Naija-Senti project. It is a list of collected stopwords from the four most widely spoken languages in Nigeria — Hausa, Igbo, Nigerian-Pidgin, and Yorùbá.nagisa_stopwords
Japanese Stopwords for nagisa
This dataset is the Japanese stopwords list built into nagisa (v0.2.12+). It is published here on Hugging Face for easy access and reproducibility.
Overview
Language
Japanese
Size
147 words
Source
CC-100, Wikipedia
License
MIT
Dataset Description
This dataset contains 147 frequently used Japanese words extracted from large-scale corpora. Each word is annotated with its part-of-speech (POS) tag according… See the full description on the dataset page: https://huggingface.co/datasets/taishi-i/nagisa_stopwords.stopwords-en
Stopwords EN (Teeny-Tiny Castle)
This dataset is part of a tutorial tied to the Teeny-Tiny Castle, an open-source repository containing educational tools for AI Ethics and Safety research.
How to Use
from datasets import load_dataset
dataset = load_dataset("AiresPucrs/stopwords-en", split = 'train')
stopwordsturkish-stopwords
🇹🇷 TR Turkish Stopwords – Extended List (504 Words)
This dataset contains the most comprehensive and extended list of Turkish stopwords, curated specifically for Natural Language Processing (NLP) tasks involving the Turkish language.
📦 Dataset Overview
Total Stopwords: 504
Format: JSON
Key: "stopwords"
File Size: ~7.7 kB
License: Apache 2.0
📚 Description
Türkçe:
“TR Türkçe Stopwords” veriseti, Türkçe metinlerde en sık karşılaşılan… See the full description on the dataset page: https://huggingface.co/datasets/nezahatkorkmaz/turkish-stopwords.sst2-remove-non-stopwords-n2
Dataset Card for "sst2-remove-non-stopwords-n2"
More Information needed
sst2-remove-non-stopwords-n5
Dataset Card for "sst2-remove-non-stopwords-n5"
More Information needed
tajik-stopwords
Tajik Language Stopwords
Data Period: Contains common stopwords of the Tajik languageLast Update: 2025-04-12Number of Records: 1
Sample Data
stopword
-он,-ҳо,-ӣ,а,агар,агар ки,агар чи,агар-чанд,агар-чи,аз,аз афташ,аз баҳри он ки,аз рӯи,аз рӯйи,аз ҷумла,аз-баски,азбаски,аззам,ай,ало,аммо,ана,ана ҳамин,ар,асло,аст,аё,аҳа,аҷабо,ба,ба монанди,ба тразе ки,ба шарте,ба-,бай-бай,баланд,бале,балки,бар,баробар,барои,барои он ки,баръакс,баъд,баъд аз,баъд аз он ки,баъдан… See the full description on the dataset page: https://huggingface.co/datasets/ArabovMK/tajik-stopwords.stopwords-pt
Stopwords PT (Teeny-Tiny Castle)
This dataset is part of a tutorial tied to the Teeny-Tiny Castle, an open-source repository containing educational tools for AI Ethics and Safety research.
How to Use
from datasets import load_dataset
dataset = load_dataset("AiresPucrs/stopwords-pt", split = 'train')
amharic-stopwords
Amharic Stopwords
The stopwords are build by Yimam et al. (2021) at LT Group, University of Hamburg, Germany.
Initially, they were generated using an automated approach based on frequency, followed by manual validation.
Source
GitHub https://github.com/uhh-lt/ethiopicmodels
Dataset: https://github.com/uhh-lt/ethiopicmodels/blob/master/am/normalization/amstopwords.txt
Paper: https://www.mdpi.com/1999-5903/13/11/275
For citing this stopwords, please use the following:… See the full description on the dataset page: https://huggingface.co/datasets/uhhlt/amharic-stopwords.sst2-remove-stopwords-n2
Dataset Card for "sst2-remove-stopwords-n2"
More Information needed
italian-stopwordsreklambox-balanced-no-stopwords
Dataset Card for "reklambox-balanced-no-stopwords"
More Information needed
sst2-remove-stopwords-n5
Dataset Card for "sst2-remove-stopwords-n5"
More Information needed
chinese_stopwordsswahili_stopwords
Swahili Stop-Words Dataset
The Swahili Stop-Words Dataset is a curated collection of function words that carry minimal semantic weight and are commonly omitted during text preprocessing in Natural Language Processing (NLP) workflows.
While these words are essential for the syntactic structure of Swahili, they can be excluded from most computational tasks without compromising the overall semantic integrity of the text.
The availability of this dataset is critical for optimizing… See the full description on the dataset page: https://huggingface.co/datasets/alfredkondoro/swahili_stopwords.tajik-stopwords
Tajik Language Stopwords
Data Period: Contains common stopwords of the Tajik languageLast Update: 2025-04-12Number of Records: 1
Sample Data
stopword
-он,-ҳо,-ӣ,а,агар,агар ки,агар чи,агар-чанд,агар-чи,аз,аз афташ,аз баҳри он ки,аз рӯи,аз рӯйи,аз ҷумла,аз-баски,азбаски,аззам,ай,ало,аммо,ана,ана ҳамин,ар,асло,аст,аё,аҳа,аҷабо,ба,ба монанди,ба тразе ки,ба шарте,ба-,бай-бай,баланд,бале,балки,бар,баробар,барои,барои он ки,баръакс,баъд,баъд аз,баъд аз он ки,баъдан… See the full description on the dataset page: https://huggingface.co/datasets/TajikNLPWorld/tajik-stopwords.stopwordsindex_stopwordsvietnamese-stopwordsindo-stopwordskaa_stopwords_v1.txt
About
Language: Karakalpak (Latin script)Size: 402 unique words (one per line, UTF-8 encoded)Source: Extracted and compiled from formal written content, later normalized into a single list.This is Version 1 of the Karakalpak stopword list. Future releases may include:
Future versions:
Expanded coverageMore informal / naturalized vocabularyRefinements and corrections
model_test_stopwords