Datasetpublic

reasoning-degeneration-dev/t1-wingdings-arena-frozenlake-together_ai-moonshotai-kimi-k2-thinking-4636da73

t1-wingdings-arena-frozenlake-together_ai-moonshotai-kimi-k2-thinking-4636da73 Wingdings compliance evaluation on TextArena games. Model must reason using only symbolic characters while playing interactive games. Compliance is measured on reasoning text only, not action commands. Results Metric Value Win rate 9/10 Compliance (mean) 0.2951 Errors 0 Details Parameter Value Model together_ai/moonshotai/Kimi-K2-Thinking… See the full description on the dataset page: https://huggingface.co/datasets/reasoning-degeneration-dev/t1-wingdings-arena-frozenlake-together_ai-moonshotai-kimi-k2-thinking-4636da73.

sourceHugging Facemitupdated 7mo agoView on Hugging Face

0likes7downloads

Dataset Card

t1-wingdings-arena-frozenlake-together_ai-moonshotai-kimi-k2-thinking-4636da73

Wingdings compliance evaluation on TextArena games.

Model must reason using only symbolic characters while playing interactive games. Compliance is measured on reasoning text only, not action commands.

Results

Metric	Value
Win rate	9/10
Compliance (mean)	0.2951
Errors	0

Details

Parameter	Value
Model	`together_ai/moonshotai/Kimi-K2-Thinking`
Thinking	True
Games	FrozenLake-v0, FrozenLake-v0, FrozenLake-v0, FrozenLake-v0, FrozenLake-v0, FrozenLake-v0, FrozenLake-v0, FrozenLake-v0, FrozenLake-v0, FrozenLake-v0

Usage

python

from datasets import load_dataset
ds = load_dataset("reasoning-degeneration-dev/t1-wingdings-arena-frozenlake-together_ai-moonshotai-kimi-k2-thinking-4636da73", split="train")
print(f"Mean compliance: {sum(ds['wingdings_compliance']) / len(ds):.4f}")

Tracked in [reasoning-degeneration-dev/PROJECT-MANIFEST](https://huggingface.co/datasets/reasoning-degeneration-dev/PROJECT-MANIFEST)