CoolFace
Datasetpublic

cstr/de-wiktionary-sqlite-full

German Wiktionary - FULL Normalized SQLite Database This is a complete, lossless, and fully normalized SQLite database of German Wiktionary, capturing 100% of the structured data from the cstr/de-wiktionary-extracted dataset. It is designed for production-ready applications, complex linguistic analysis, and mobile apps (Flutter, React Native) that require a comprehensive local dictionary. 🎯 Key Features βœ… 100% Lossless: All 30+ top-level and nested fields from… See the full description on the dataset page: https://huggingface.co/datasets/cstr/de-wiktionary-sqlite-full.

sourceHugging Facecc-by-sa-4.0updated 10mo agoView on Hugging Face
0likes33downloads
Dataset Card

German Wiktionary - FULL Normalized SQLite Database

This is a complete, lossless, and fully normalized SQLite database of German Wiktionary, capturing 100% of the structured data from the cstr/de-wiktionary-extracted dataset.

It is designed for production-ready applications, complex linguistic analysis, and mobile apps (Flutter, React Native) that require a comprehensive local dictionary.

🎯 Key Features

  • β€”βœ… 100% Lossless: All 30+ top-level and nested fields from the source JSONL are preserved.
  • β€”βš‘ Fast Queries: Fully indexed schema for sub-20ms queries.
  • β€”πŸ”— Full Semantic Web: Includes all semantic relations (synonyms, antonyms, hypernyms, hyponyms, meronyms, holonyms, coordinate_terms).
  • β€”πŸ—£οΈ Rich Content: Includes expressions, proverbs, and entry notes in addition to definitions and examples.
  • β€”πŸ“± Mobile-ready: Optimized for sqflite (Flutter) and other local DB use cases.
  • β€”(and all features from the standard DB: forms, translations, sounds, etc.)

πŸ“Š Database Statistics

  • β€”Entries: 970,801
  • β€”Word Senses: 3,098,364
  • β€”Definitions (Glosses): 3,087,300
  • β€”Translations: 1,131,251
  • β€”Word Forms (Inflections): 6,100,090
  • β€”Form Tags (Total): 25,966,680
  • β€”Pronunciations (Sounds): 2,327,762
  • β€”Usage Examples: 427,322
  • β€”Synonyms: 161,563
  • β€”Antonyms: 76,054
  • β€”Hypernyms: 133,059
  • β€”Hyponyms: 217,179
  • β€”Proverbs: 1,078
  • β€”Expressions: 13,138
  • β€”Descendants: 211
  • β€”Entry Notes: 16,536
  • β€”Unique Tags: 185
  • β€”Unique Topics: 58
  • β€”Unique Categories: 352

πŸ—οΈ Database Schema (Full)

This schema includes all tables from the standard de-wiktionary-sqlite-normalized dataset, plus the following additions:

  • β€”entries:
  • β€”title: The Wiktionary page title.
  • β€”redirect: The page this entry redirects to (if any).
  • β€”entry_notes: (New Table) Free-text notes associated with an entry (e.g., "Es gibt etliche Belege fΓΌr die Steigerung...").
  • β€”other_pos: (New Table) Alternative part-of-speech values for this word.
  • β€”entry_raw_tags: (New Table) Unparsed, raw tags from Wiktionary.
  • β€”descendants: (New Table) Words in other languages descended from this word.
  • β€”hypernyms: (New Table) "Is-a" relationship (e.g., "Tier" is a hypernym of "Hund").
  • β€”hyponyms: (New Table) "Type-of" relationship (e.g., "Hund" is a hyponym of "Tier").
  • β€”holonyms: (New Table) "Part-of" relationship (e.g., "Hand" is a holonym of "Finger").
  • β€”meronyms: (New Table) "Has-a" relationship (e.g., "Finger" is a meronym of "Hand").
  • β€”coordinate_terms: (New Table) Sibling terms (e.g., "Hund" and "Katze" are coordinate terms under "Haustier").
  • β€”expressions: (New Table) Idiomatic expressions using the word (linked to sense_id).
  • β€”proverbs: (New Table) Proverbs using the word (linked to sense_id).

(For the standard schema, see the `cstr/de-wiktionary-sqlite-normalized` dataset card)

πŸ“– Usage

Download

python
from huggingface_hub import hf_hub_download
import sqlite3
import gzip
import shutil

# Download compressed database
db_gz_path = hf_hub_download(
    repo_id="cstr/de-wiktionary-sqlite-full",
    filename="de_wiktionary_normalized_full.db",
    repo_type="dataset"
)

# Decompress (if it's .gz)
db_path = db_gz_path.replace('.gz', '')
with gzip.open(db_gz_path, 'rb') as f_in:
    with open(db_path, 'wb') as f_out:
        shutil.copyfileobj(f_in, f_out)

# Connect
conn = sqlite3.connect(db_path)

Example Query (New Tables)

python
# Get all hypernyms (parent categories) for "Hund"
cursor.execute('''
    SELECT h.hypernym_word
    FROM entries e
    JOIN hypernyms h ON e.id = h.entry_id
    WHERE e.word = ? AND e.lang = 'Deutsch'
''', ('Hund',))

print("Hypernyms of 'Hund':", [row[0] for row in cursor.fetchall()])

πŸ”— Source

Original data: cstr/de-wiktionary-extracted

πŸ“œ License

CC-BY-SA 4.0 (same as source)