semianalysisai/cc-traces-weka-with-subagents-060826-256k

semianalysisai/cc-traces-weka-with-subagents-060826-256k

WekaTrace corpus derived from SemiAnalysis Claude Code proxy traces. Built 2026-06-08 20:48:46 UTC via utils/agentic/build_weka_hf_dataset.py.

Derived from semianalysisai/cc-traces-weka-with-subagents-060826 by applying the 256k per-request cap and reshifting the surviving timeline.

Filters

• —Trace version: exactly v6
• —min main-agent turns per session: 20
• —Claude Code CLI ≥ 2.1.139 (every row)
• —peak concurrent sub-agent groups ≤ 10
• —Non-image rows only (image content excluded at source)
• —Classifier calls excluded (max_tokens<=64 AND no tools → SUGGESTION MODE, title-gen, Security Monitor)
• —Exact-duplicate proxy rows deduped by (timestamp, model, in, out, dur_ms, agent_id)
• —256k per-request cap (see 256k filter rule below)

256k filter rule

• —Per-request input + output ≤ 256,000 tokens. Applied at request granularity, not conversation. Main-agent and sub-agent inner requests are evaluated independently.
• —Sub-agent groups where every inner request was filtered → entire group dropped.
• —Sub-agent groups with only some inners filtered → partial group kept (surviving inners retained).
• —Timeline reshift: each trace's request t values are recomputed so gaps from removed requests collapse:

  First surviving entry:  t = 0
  Each subsequent:        new_t = prev_t + prev_api_time + this.think_time

Stats

traces:             391
main_turns:          70,325
subagent_groups:             612
subagent_inner_requests:          16,119
total_model_requests:          86,444
total_input_tokens:   7,708,668,032
total_output_tokens:      77,283,168

Distribution plots

Main-agent stream

[image]

[image]

Sub-agent fan-out

[image]

[image]

Source script

python utils/agentic/sample_proxy_traces.py --out '<workdir>/proxy' --sampling top --min-trace-version 6 --max-trace-version 6 --min-main-turns 20 --require-cli-min 2.1.139 --max-parallel-subagents 10

Loader plugin

Load in aiperf via:

--public-dataset semianalysis_cc_traces_weka_with_subagents_256k