Datasetpublic

yinita/ps4mas-ps-scale

PS4MAS PS scale Current PS / scale experiment catalog This generated section is authoritative. Older tables above are historical. Each experiments/<name>/ contains unified episodes.parquet, meta.json, and an unmodified summary.json when available. Raw full-hop traces.jsonl and run_config.json are separate files; scores are never injected into raw traces. Partial snapshots have immutable content-derived names. Existing experiments are skipped unless… See the full description on the dataset page: https://huggingface.co/datasets/yinita/ps4mas-ps-scale.

sourceHugging Facemitupdated 6d agoView on Hugging Face

0likes690downloads

Dataset Card

PS4MAS PS scale

Current PS / scale experiment catalog

This generated section is authoritative. Older tables above are historical.

Each experiments/<name>/ contains unified episodes.parquet, meta.json, and an unmodified summary.json when available. Raw full-hop traces.jsonl and run_config.json are separate files; scores are never injected into raw traces.

Partial snapshots have immutable content-derived names. Existing experiments are skipped unless --overwrite-existing is explicit. Routine uploads use additions only. Explicitly authorized, content-audited invalid-data cleanups are recorded separately under audits/.

Experiment	Model	Episode rows	Run	Judge	Full hops	Dataset
0911/scale_penguin_final/qwen35_27b/central_b3	scaleqwen3527bcentralb3	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/central_bmax	scaleqwen3527bcentralbmax	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/central_bmax__partial_2a3c8ac1dfd699e6	scaleqwen3527bcentralbmax	624	[ ]	[ ]	624/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/central_bmax__partial_6dfc1d2c5881422b	scaleqwen3527bcentralbmax	331	[ ]	[ ]	331/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/central_bmax__partial_7993c24a29d9b8cd	scaleqwen3527bcentralbmax	288	[ ]	[ ]	288/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/debate_b3	scaleqwen3527bdebateb3	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/debate_b3__partial_d3a8b45c1dd6c871	scaleqwen3527bdebateb3	725	[ ]	[ ]	725/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/debate_b3__partial_dcf6759cce01781e	scaleqwen3527bdebateb3	362	[ ]	[ ]	362/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/debate_bmax	scaleqwen3527bdebatebmax	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/debate_bmax__partial_4e750fdcd5d846a1	scaleqwen3527bdebatebmax	249	[ ]	[ ]	249/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/debate_bmax__partial_9c4db2a1f386e9d7	scaleqwen3527bdebatebmax	628	[ ]	[ ]	628/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/discuss_decide_b3	scaleqwen3527bdiscussdecide_b3	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/discuss_decide_b3__partial_87042dafe0a1a210	scaleqwen3527bdiscussdecide_b3	283	[ ]	[ ]	283/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/discuss_decide_bmax	scaleqwen3527bdiscussdecide_bmax	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/discuss_decide_bmax__partial_63f1c4d7d60cd904	scaleqwen3527bdiscussdecide_bmax	757	[ ]	[ ]	757/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/plan_execute_b3	scaleqwen3527bplanexecute_b3	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_27b/plan_execute_bmax	scaleqwen3527bplanexecute_bmax	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/central_b3	scaleqwen359bcentralb3	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/central_bmax	scaleqwen359bcentralbmax	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/debate_b3	scaleqwen359bdebateb3	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/debate_bmax	scaleqwen359bdebatebmax	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/discuss_decide_b3	scaleqwen359bdiscussdecide_b3	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/discuss_decide_bmax	scaleqwen359bdiscussdecide_bmax	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/discuss_decide_bmax__partial_51e0f330abe2eef7	scaleqwen359bdiscussdecide_bmax	319	[ ]	[ ]	319/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/discuss_decide_bmax__partial_56ef3f07845c3940	scaleqwen359bdiscussdecide_bmax	673	[ ]	[ ]	673/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/plan_execute_b3	scaleqwen359bplanexecute_b3	800	[x]	[ ]	800/800	PENGUIN (see meta)
0911/scale_penguin_final/qwen35_9b/plan_execute_bmax	scaleqwen359bplanexecute_bmax	800	[x]	[ ]	800/800	PENGUIN (see meta)

Run = all intended scenario/config pairs produced a record; blank answers remain flagged in meta. Judge = every intended pair has valid non-mock scores. Mock placeholders never count as completed judging. Score-only historical results are archived as snapshots and do not prove runtime profile correctness. Full-hop coverage is a separate requirement. No missing historical hops are regenerated automatically.