CoolFace
Datasetpublic

ClarusC64/description-granularity-consistency-v0.1

What this is This dataset tests whether abstract state remains stable across description depth. Same event.A coarse description.A fine description. A coherent model should land in the same state either way. What it measures • Whether abstraction changes when wording gets more technical• Whether the model keeps the same implied world state across granularity shifts A model that binds state to language style will fail. Expected model output Return only: AorB Scoring Use the shared Clarus scorer.… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/description-granularity-consistency-v0.1.

sourceHugging Facemitupdated 8mo agoView on Hugging Face
0likes35downloads
Dataset Card

What this is

This dataset tests whether abstract state remains stable across description depth.

Same event. A coarse description. A fine description.

A coherent model should land in the same state either way.

What it measures

• Whether abstraction changes when wording gets more technical • Whether the model keeps the same implied world state across granularity shifts

A model that binds state to language style will fail.

Expected model output

Return only:

A or B

Scoring

Use the shared Clarus scorer.

Metrics:

• accuracy • parse_rate

Suggested prompt

You are checking whether two levels of description imply the same world state.

Scene: {scene}

Coarse description: {desc_coarse}

Fine description: {desc_fine}

A: {optiona} B: {optionb}

Choose the consistent interpretation. Answer with only A or B.

Trinity placement

This is Dataset III of the Abstract State Consistency Trinity.

Citation

ClarusC64. "Clarus Description Granularity Consistency v0.1", 2026.