stopwords
target-stopwords
target-stopwords
Per-language function-word lists, induced from that language's own Bible text — frequency +
dispersion (the classic corpus-linguistics stopword-induction recipe), then RESCUED against the
language's own alignment output + a source-anchored content signal so genuinely frequent CONTENT words
("God", "Lord") are never dropped.
A candidate word is rescued out of the list (judged a real content word, not a function word) only when
all four hold — see the… See the full description on the dataset page: https://huggingface.co/datasets/bcv-commons/target-stopwords.stopwords
NLTK Stopwords
Stopword lists from NLTK, covering 33 languages.
Each language is a separate config. Each row is one stopword.
Usage
from datasets import load_dataset
# Load one language
ds = load_dataset("nltk-data-hub/stopwords", "portuguese")
words = ds["stopwords"]["word"]
# Load all languages
for lang in ['albanian', 'arabic', 'azerbaijani', 'basque', 'belarusian', 'bengali', 'catalan', 'chinese', 'danish', 'dutch', 'english', 'finnish', 'french', 'german', 'greek'… See the full description on the dataset page: https://huggingface.co/datasets/nltk-data-hub/stopwords.hausa-stopwords-corpus
Hausa Stopword Candidates and Frequency Scores
A reproducible Hausa lexical resource containing frequency-scored stopword candidates. This repository is organized for inspection, preprocessing experiments, and future Hausa-speaker review. It does not publish a final stopword list or a final human-reviewed stopword count.
Quick navigation
Need
Go to
Browse candidates in the Dataset Viewer
data/hausa_stopword_candidates.jsonl
Efficient analysis… See the full description on the dataset page: https://huggingface.co/datasets/VelkroLM/hausa-stopwords-corpus.stop_wordsstop_wordsstop_words