nickh007/specforge

specforge — a verification benchmark that cannot be memorised 600 protocol-shaped state machines whose ground truth was computed by an exhaustive model checker, not written down by hand. Every fixed benchmark has a shelf life: once its answers are in a training corpus, a high score stops telling you whether a model reasons or remembers. This snapshot is generated, and the generator is public — so when this set ages, you make a new one with a different seed rather than trusting a… See the full description on the dataset page: https://huggingface.co/datasets/nickh007/specforge.