datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
smyth-grammar
smyth-grammar
Herbert Weir Smyth, A Greek Grammar for Colleges (New York: American Book
Company, 1920 — public domain). PROSE-witness t0 source repo for Greek
morphology and syntax, the sibling of allen-greenough-grammar (Latin) and
gesenius-kautzsch-grammar (Hebrew) in the distributional-grammar programme:
one row per numbered Smyth paragraph (§1–§3048, complete, plus the 213
"D"-suffixed dialect paragraphs), Greek examples in polytonic Unicode, Smyth's
own cross-references as… See the full description on the dataset page: https://huggingface.co/datasets/NuBerea/smyth-grammar.formal-grammar-llm-benchmark
A formal grammar benchmark to study learning and memorization of large language models
Usage
Load a specific grammar (config) and split:
from datasets import load_dataset
ds = load_dataset(
"<username>/formal-grammar-llm-benchmark",
name="pcfg_cfg3b_eq_len_skewed_prob",
)
# available splits per grammar:
# train_sequences, test_sequences, non_grammatical_sequences,
# non_grammatical_*_grammar_edit_*, non_grammatical_*_edit_distance_*… See the full description on the dataset page: https://huggingface.co/datasets/hoisoserious/formal-grammar-llm-benchmark.scoutieDataset_russian_language_grammar_and_rules_vectorized
Description in English:
A dataset collected from 30 Russian-language Telegram channels on the topic of learning the Russian language. This dataset contains grammar, syntax, spelling and punctuation rules.
The dataset was collected and marked automatically using the Scoutie data collection and marking service.Try Scoutie and collect the same or another dataset using the link.
Dataset fields:
taskId - task identifier in the Scouti service. text - main text. url -… See the full description on the dataset page: https://huggingface.co/datasets/ScoutieAutoML/scoutieDataset_russian_language_grammar_and_rules_vectorized.scoutieDataset_chinese_russian_dictionary_grammar_spelling_vectorized
Description in English:
A dataset collected from 30 Russian-language Telegram channels on the topic of learning Chinese, this dataset contains grammar, syntax, spelling and punctuation rules, as well as Chinese words with Russian translations.
The dataset was collected and marked automatically using the Scoutie data collection and marking service.Try Scoutie and collect the same or another dataset using the link.
Dataset fields:
taskId - task identifier in the… See the full description on the dataset page: https://huggingface.co/datasets/ScoutieAutoML/scoutieDataset_chinese_russian_dictionary_grammar_spelling_vectorized.scoutieDataset_english_russian_dictionary_grammar_spelling_vectorized
Description in English:
A dataset collected from 30 Russian-language Telegram channels on the topic of learning English, this dataset contains grammar, syntax, spelling and punctuation rules, as well as English words with Russian translations.
The dataset was collected and marked automatically using the Scoutie data collection and marking service.Try Scoutie and collect the same or another dataset using the link.
Dataset fields:
taskId - task identifier in the… See the full description on the dataset page: https://huggingface.co/datasets/ScoutieAutoML/scoutieDataset_english_russian_dictionary_grammar_spelling_vectorized.