reasoning-drift
reasoning-drift-onset-detection-v0.1
Important Evaluation Limitation
Version 0.1 uses a highly regular trajectory structure in which the first drift step is frequently located at Step 4 and visible failure commonly appears at Step 5.
This creates a positional shortcut: a model may achieve inflated onset-detection performance by learning the dataset construction pattern rather than analysing the reasoning trajectory.
Version 0.1 should therefore be treated as a task-definition and scorer-validation release, not as a… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/reasoning-drift-onset-detection-v0.1.reasoning-drift-onset-detection-v0.2A SIOS structured reasoning-state benchmark for detecting when a reasoning trajectory loses a governing constraint, identifying the structural form of that drift, and assessing whether the failure is repaired.
Repository:
ClarusC64/reasoning-drift-onset-detection-v0.2
Version:
0.2.0
Publisher:
Clarus Invariant
Framework:
SIOS
Benchmark identity
Reasoning Drift Onset Detection v0.2 is not a single-label classification benchmark.
It is a structured reasoning-state benchmark.… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/reasoning-drift-onset-detection-v0.2.