Datasetpublic

CircularBalls/tt639e-context-copy-ladder-v1

TT639E Context Copy Ladder v1 This rung isolates context extraction/copy behavior. Blocking gates: seen_pass tt639d_seen_value_context_regression_pass heldout_seen_value_pass Non-blocking measured challenge: open_copy_challenge_pass Why: TT639D defaulted to memorized answers such as Riley/silver. This script balances answer values and tests unseen templates with values that appeared as answers during training. Open-copy with entirely unseen answer values is a harder… See the full description on the dataset page: https://huggingface.co/datasets/CircularBalls/tt639e-context-copy-ladder-v1.

sourceHugging Faceupdated 3mo agoView on Hugging Face

0likes4downloads

Dataset Card

TT639E Context Copy Ladder v1

This rung isolates context extraction/copy behavior.

Blocking gates:

—seen_pass
—tt639dseenvaluecontextregression_pass
—heldoutseenvalue_pass

Non-blocking measured challenge:

—opencopychallenge_pass

Why: TT639D defaulted to memorized answers such as Riley/silver. This script balances answer values and tests unseen templates with values that appeared as answers during training. Open-copy with entirely unseen answer values is a harder pointer/copy-style skill and is recorded separately.