Datasetpublic

lfqian/annulus-heldout

annulus-heldout Held-out eval sets for the year-plugin project (same-source as 0X_filtered training, held out = not in training). FY2001/heldout_2001_samesource.jsonl - 783 docs, all date=2001, same-source mix (common_corpus/USPTO/sec_edgar/arxiv). Use for FY2001 self-year absorption. multiyear/eval_heldout.jsonl - ~10k docs, year/bucket_id/year_token, buckets 1500s..2000. Use for cross-year (far-year) cutoff. Convention for later years Add each new year's… See the full description on the dataset page: https://huggingface.co/datasets/lfqian/annulus-heldout.

sourceHugging Faceupdated 3d agoView on Hugging Face

0likes92downloads

Dataset Card

annulus-heldout

Held-out eval sets for the year-plugin project (same-source as 0X_filtered training, held out = not in training).

—FY2001/heldout_2001_samesource.jsonl - 783 docs, all date=2001, same-source mix (commoncorpus/USPTO/secedgar/arxiv). Use for FY2001 self-year absorption.
—multiyear/eval_heldout.jsonl - ~10k docs, year/bucketid/yeartoken, buckets 1500s..2000. Use for cross-year (far-year) cutoff.

Convention for later years

Add each new year's same-source held-out under FY<year>/heldout_<year>_samesource.jsonl (carved from that year's 0X_filtered repo, docs NOT used in training).