Publishing/unclutching-corpus-v3
Unclutching Corpus v3 English-only, quality-filtered excerpts discussing the meditation concept of unclutching, extracted from books and transcripts, de-duplicated, and cleaned. Stats Records: 1,012 Total characters: 679,435 Avg chars per record: 671 Schema Single column: { "text": "string" } Filtering pipeline Built from a 3,766-row deduplicated source corpus by: Dropping non-English sources (lang-tagged translations, non-Latin… See the full description on the dataset page: https://huggingface.co/datasets/Publishing/unclutching-corpus-v3.
Unclutching Corpus v3
English-only, quality-filtered excerpts discussing the meditation concept of unclutching, extracted from books and transcripts, de-duplicated, and cleaned.
Stats
- Records: 1,012
- Total characters: 679,435
- Avg chars per record: 671
Schema
Single column:
{ "text": "string" }Filtering pipeline
Built from a 3,766-row deduplicated source corpus by:
- Dropping non-English sources (lang-tagged translations, non-Latin script).
- Dropping institutional / promotional KAILASA boilerplate.
- Stripping transcript timestamp markers (e.g.
**[00:17:02]**,**10:28**). - Dropping markdown table / table-of-contents excerpts.
- Dropping excerpts truncated mid-sentence (
...at start/end). - Requiring
n_chars >= 250after cleaning. - Requiring
n_unclutch >= 2(the term must actually be discussed, not just name-dropped). - Light English-language sanity check via common function-word presence.
