Datasetpublic

insightSynthesisData/thinking-design-v3-harness

thinking_design_v3 — does any multi-turn harness beat single-pass ideation? Arm outputs, harness turn traces, and judge verdicts for a matched-idea-budget comparison of single-pass ideation against two multi-turn harnesses, on Qwen3-4B-SI and Qwen3-8B-SI over a fixed 100-instance slice. Layout path what arms/arms_<model>_<arm>.jsonl 3-idea sets per instance. _goldlc = same candidates, gold compressed to the candidate length turns/twoturn_h{2,4}_{4b… See the full description on the dataset page: https://huggingface.co/datasets/insightSynthesisData/thinking-design-v3-harness.

sourceHugging Faceotherupdated 1mo agoView on Hugging Face

0likes177downloads

root.gitattributes

.gitattributes91 linesDownload Raw Back to root

1*.7z filter=lfs diff=lfs merge=lfs -text2*.arrow filter=lfs diff=lfs merge=lfs -text3*.avro filter=lfs diff=lfs merge=lfs -text4*.bin filter=lfs diff=lfs merge=lfs -text5*.bz2 filter=lfs diff=lfs merge=lfs -text6*.ckpt filter=lfs diff=lfs merge=lfs -text7*.ftz filter=lfs diff=lfs merge=lfs -text8*.gz filter=lfs diff=lfs merge=lfs -text9*.h5 filter=lfs diff=lfs merge=lfs -text10*.joblib filter=lfs diff=lfs merge=lfs -text11*.lfs.* filter=lfs diff=lfs merge=lfs -text12*.lz4 filter=lfs diff=lfs merge=lfs -text13*.mds filter=lfs diff=lfs merge=lfs -text14*.mlmodel filter=lfs diff=lfs merge=lfs -text15*.model filter=lfs diff=lfs merge=lfs -text16*.msgpack filter=lfs diff=lfs merge=lfs -text17*.npy filter=lfs diff=lfs merge=lfs -text18*.npz filter=lfs diff=lfs merge=lfs -text19*.onnx filter=lfs diff=lfs merge=lfs -text20*.ot filter=lfs diff=lfs merge=lfs -text21*.parquet filter=lfs diff=lfs merge=lfs -text22*.pb filter=lfs diff=lfs merge=lfs -text23*.pickle filter=lfs diff=lfs merge=lfs -text24*.pkl filter=lfs diff=lfs merge=lfs -text25*.pt filter=lfs diff=lfs merge=lfs -text26*.pth filter=lfs diff=lfs merge=lfs -text27*.rar filter=lfs diff=lfs merge=lfs -text28*.safetensors filter=lfs diff=lfs merge=lfs -text29saved_model/**/* filter=lfs diff=lfs merge=lfs -text30*.tar.* filter=lfs diff=lfs merge=lfs -text31*.tar filter=lfs diff=lfs merge=lfs -text32*.tflite filter=lfs diff=lfs merge=lfs -text33*.tgz filter=lfs diff=lfs merge=lfs -text34*.wasm filter=lfs diff=lfs merge=lfs -text35*.xz filter=lfs diff=lfs merge=lfs -text36*.zip filter=lfs diff=lfs merge=lfs -text37*.zst filter=lfs diff=lfs merge=lfs -text38*tfevents* filter=lfs diff=lfs merge=lfs -text39# Audio files - uncompressed40*.pcm filter=lfs diff=lfs merge=lfs -text41*.sam filter=lfs diff=lfs merge=lfs -text42*.raw filter=lfs diff=lfs merge=lfs -text43# Audio files - compressed44*.aac filter=lfs diff=lfs merge=lfs -text45*.flac filter=lfs diff=lfs merge=lfs -text46*.mp3 filter=lfs diff=lfs merge=lfs -text47*.ogg filter=lfs diff=lfs merge=lfs -text48*.wav filter=lfs diff=lfs merge=lfs -text49# Image files - uncompressed50*.bmp filter=lfs diff=lfs merge=lfs -text51*.gif filter=lfs diff=lfs merge=lfs -text52*.png filter=lfs diff=lfs merge=lfs -text53*.tiff filter=lfs diff=lfs merge=lfs -text54# Image files - compressed55*.jpg filter=lfs diff=lfs merge=lfs -text56*.jpeg filter=lfs diff=lfs merge=lfs -text57*.webp filter=lfs diff=lfs merge=lfs -text58# Video files - compressed59*.mp4 filter=lfs diff=lfs merge=lfs -text60*.webm filter=lfs diff=lfs merge=lfs -text61judge/gold_qwen3-4b-si_A0_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text62judge/gold_qwen3-4b-si_A0p_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text63judge/gold_qwen3-4b-si_A0pp_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text64judge/gold_qwen3-4b-si_H1_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text65judge/gold_qwen3-4b-si_H2_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text66judge/gold_qwen3-4b-si_H4_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text67judge/gold_qwen3-8b-si_A0_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text68judge/gold_qwen3-8b-si_A0p_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text69judge/gold_qwen3-8b-si_A0pp_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text70judge/gold_qwen3-8b-si_H1_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text71judge/gold_qwen3-8b-si_H2_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text72judge/gold_qwen3-8b-si_H4_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text73judge/goldlc_qwen3-4b-si_A0_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text74judge/goldlc_qwen3-4b-si_A0pp_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text75judge/goldlc_qwen3-4b-si_H2_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text76judge/goldlc_qwen3-4b-si_H4_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text77judge/goldlc_qwen3-8b-si_A0_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text78judge/goldlc_qwen3-8b-si_A0pp_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text79judge/goldlc_qwen3-8b-si_H2_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text80judge/goldlc_qwen3-8b-si_H4_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text81judge/sjgold_qwen3-4b-si_A0_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text82judge/sjgold_qwen3-4b-si_A0pp_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text83judge/sjgold_qwen3-8b-si_A0_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text84judge/sjgold_qwen3-8b-si_A0pp_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text85judge/sjgold_qwen3-8b-si_H2_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text86judge/sjgold_qwen3-8b-si_H4_with_evals.jsonl filter=lfs diff=lfs merge=lfs -text87turns/twoturn_h2_4b.jsonl filter=lfs diff=lfs merge=lfs -text88turns/twoturn_h2_8b.jsonl filter=lfs diff=lfs merge=lfs -text89turns/twoturn_h4_4b.jsonl filter=lfs diff=lfs merge=lfs -text90turns/twoturn_h4_8b.jsonl filter=lfs diff=lfs merge=lfs -text91