edithatogo/corpus-legislation-nz-historical

New Zealand Legislation Corpus - Historical Operational Repository

Registry status

• —Registry ID: edithatogo/corpus-legislation-nz-historical
• —Family: nz-legislation
• —Repository role: superseded_operational_dataset
• —Canonical dataset: `edithatogo/corpus-legislation-nz`
• —Operational status: historical
• —Rights status: source_specific_review_required
• —Authoritative catalog: `edithatogo/dataset-estate-registry`

Origin and provenance

• —Origin repository: https://github.com/edithatogo/corpus-legislation-nz
• —Upstream source: Official New Zealand Legislation API.
• —This card describes repository identity and relationships; it does not claim completeness beyond published manifests.

Rights boundary

Repository code, dataset compilation, and underlying source-record rights are separate. The registry currently records the rights state as source_specific_review_required. Where rights vary by record or source, downstream users must inspect the published provenance and rights fields.

Existing dataset documentation

This dataset repository is the live operational home for an evolving New Zealand legislation corpus pipeline. Coverage is not proven complete until reconciled against an authoritative inventory.

It is intended to be populated by the corpus-legislation-nz GitHub Actions workflow, which uses the official New Zealand Legislation API, validates and normalizes records, writes stable partitioned Parquet, and publishes annual DOI-backed archival snapshots to Zenodo.

Current status

Repository shell initialised on 2026-06-14T11:27:09.838343+00:00.

The first real data upload should be performed by the GitHub Actions workflow after the following are configured in the GitHub source repository:

• —NZ_LEGISLATION_API_KEY
• —HF_TOKEN
• —ZENODO_TOKEN
• —HF_REPO_ID=edithatogo/corpus-legislation-nz-historical

Expected layout

parquet/
  legislation_type=<type>/year=<year>/part-00000.parquet
raw_xml/
manifests/
  latest_manifest.json
  latest_changes.json
_state/
  sync_state.json

Storage strategy

This repository is designed for Hugging Face Hub's Xet-backed storage. The pipeline writes stable Parquet partitions and avoids unnecessary rewrites so unchanged chunks can be deduplicated efficiently.

Source pipeline

Source repository: https://github.com/edithatogo/corpus-legislation-nz

Citation and archiving

This live repository may change over time. For live use, cite this Hugging Face dataset URL, access date, and the manifest hash. For formal academic or fixed-version citation, cite the annual Zenodo snapshot once published.

Annual Zenodo DOI: TBD after first annual snapshot

Legal and licensing caveat

The source repository code is licensed separately. This dataset card does not relicense legislation text or third-party source material. Check the official New Zealand Legislation copyright page for Crown copyright and attribution terms. Incorporated-by-reference materials, third-party content, agency website text, logos, emblems, and non-legislative linked resources may have separate rights or restrictions. Verify licensing and source terms before downstream redistribution or commercial use.

Maintainer notes

This repository should not be edited manually during normal operation. Prefer updating the GitHub pipeline and letting the workflow publish validated changes.

Reconciliation policy

This repository is retained only while its recorded role is distinct from the canonical dataset. Renames, deletion, visibility changes, and replacement of immutable DOI snapshots require explicit human review.