CoolFace
Datasetpublic

GSMA/itu

ITU-T source mirror Part of the Open-Telco Telecom Standards Corpus.Sibling mirrors: 3GPP · ETSI · ITU-T · O-RAN · GSMA · TM Forum · CAMARA This dataset mirrors the ITU Telecommunication Standardization Sector (ITU-T) Recommendations. Every source is kept twice: original/ is the Recommendation as ITU-T released it (PDF), and marked/ is that same document converted to Markdown for search and retrieval, one raw.md per document with any figures extracted beside it. The two trees… See the full description on the dataset page: https://huggingface.co/datasets/GSMA/itu.

sourceHugging Faceotherupdated 3mo agoView on Hugging Face
0likes9.8kdownloads
Dataset Card

ITU-T source mirror

Part of the [Open-Telco Telecom Standards Corpus](https://huggingface.co/collections/GSMA/telecom-standards-corpus-6a432dc598fc32729754fecf). Sibling mirrors: 3GPP · ETSI · ITU-T · O-RAN · GSMA · TM Forum · CAMARA

This dataset mirrors the ITU Telecommunication Standardization Sector (ITU-T) Recommendations. Every source is kept twice: original/ is the Recommendation as ITU-T released it (PDF), and marked/ is that same document converted to Markdown for search and retrieval, one raw.md per document with any figures extracted beside it. The two trees share identical paths, so a file in original/ has a parsed twin at the matching path under marked/; both are grouped by ITU-T Recommendation series, the single-letter folders A through Z. manifest.jsonl carries one row per file (path, SHA-256, parse status), and STATUS.md reports how much of the corpus has been parsed.

text
itu/
  original/         # Recommendations as published, by series
    G/  H/  Q/  Y/  ...
  marked/           # Markdown mirror of original/, same paths
    Y/.../raw.md    #   one per document, images beside it
  manifest.jsonl    # one row per file: path, sha256, parse status
  STATUS.md         # parse-coverage summary

How it is organized

  • original/ holds the Recommendations as ITU-T published them (PDF), grouped by series (the single-letter folders A through Z).
  • marked/ is the Markdown twin of original/ at identical paths, one raw.md per document with figures beside it.
  • manifest.jsonl carries one row per file (path, SHA-256, parse status); STATUS.md reports parse coverage.

How to use

Pull only the Markdown twins (skip the heavy original/ tree) and read them straight:

python
from huggingface_hub import snapshot_download

path = snapshot_download("GSMA/itu", repo_type="dataset", allow_patterns="marked/**")
# every parsed document is a marked/**/raw.md

The corpus

This dataset is part of the Open-Telco Telecom Standards Corpus, an effort to make telecommunications open by mirroring every major standards body into clean, machine-readable Markdown. The full set: 3GPP, ETSI, ITU-T, O-RAN, GSMA, TM Forum, and CAMARA. Browse them all in the collection.

License and attribution

The mirrored documents remain the property of ITU and stay subject to its terms; see www.itu.int. This dataset reproduces them in original and Markdown form for research, search, and retrieval. Cite the underlying Recommendation by its ITU-T number when you use it.

GSMA/itu · CoolFace