lszoszk/treaty-bodies-general-comments
Treaty Bodies General Comments A paragraph-level dataset of General Comments and General Recommendations adopted by the nine UN human-rights Treaty Bodies, with concerned-group labels and document metadata. Companion to the UNHRD search interface. Licence The curated dataset (paragraph segmentation, label annotation, document metadata enrichment, footnote and section work) is released under Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International… See the full description on the dataset page: https://huggingface.co/datasets/lszoszk/treaty-bodies-general-comments.
GC_info.json: CRC GC6 under its real symbol, CAT/OP/GC/1 record added, statusSource on UN Documents, paragraph counts synced
v3.1: footnotes re-derived (3,203 notes, printed numbering), six signatures corrected, source_url on UN Documents, opus-audit article references
v3: refresh corpus (7,216 ¶) + add cited_articles column (4,613 treaty-article references, regex+Sonnet+Opus resolution)
v2.4: Cat-F refinement — strip 5 more ¶ with multi-header chain tails
v2.3: Cat-F — strip 63 trailing section headers glued to ¶ text across 6 docs
v2.2: corpus quality — fix joint GC23/GC4 + GC22/GC3 metadata (year 2019→2017, swapped titles), strip 36 stray fn digits, normalise 1223 section header spaces
v2.1: repair 87 misplaced [[fn:N]] markers across 9 GC docs (Cat-A split-word + Cat-B No.+digit)
v2: rebuild from UNHRD v19.43 corpus — 187 GCs (was 181), footnotes (3520, 249 cross-refs resolved), section paths, preamble flags, footnotesVerified provenance on all docs
Update licence to CC BY-NC-SA 4.0; refresh citation block + YAML front-matter
Add label annotation method details to dataset card and metadata
Upload Treaty Bodies General Comments dataset package
initial commit