synthetix-institute/latex-data

Hyperion: Scientific LaTeX Corpus

This dataset constitutes the Internal Scientific Corpus for the Hyperion Project of Synthetix Institute. It contains LaTeX source documents used for high-fidelity relational extraction and internal benchmarking of the Epistemic Manifold.

Dataset Details

• —Total Documents: ~1,192,727 (Internal Base)
• —Status: Private
• —Access: Restricted to Synthetix Institute authorized personnel.
• —Primary Use: Training the private sector of the Epistemic Manifold and validating domain-divergence strategies.

Dataset Structure

The schema mirrors the public corpus to ensure pipeline compatibility:

Usage (Internal Only)

Authorized users can access this dataset via the internal HF connection:

from datasets import load_dataset
import os

# Ensure HF_TOKEN is set in environment
ds = load_dataset(
    "synthetix-institute/latex-data", 
    split="train", 
    streaming=True, 
    use_auth_token=True
)

for row in ds:
    # Process internal data
    pass

Maintenance

This dataset is maintained by the Synthetix Institute. For questions regarding the Hyperion Discovery Engine or the Epistemic Manifold, please refer to the project documentation.