CoolFace
Datasetpublic

rl-rag/personalfinance-gpt-oss-120b

personalfinance-gpt-oss-120b Deep research agent evaluation on data/drtulu_personalfinance.jsonl (normal split). Results Metric Value pass@4 0.0% avg@4 0.0% Trajectory accuracy 0.0% (0/18772) Questions 4693 Trajectories 18772 (4 per question) Avg tool calls 15.7 Full conversations ✅ Model & Setup Model gpt-oss-120b Judge gpt-4o Max tool calls 50 Temperature 0.7 Blocked domains None… See the full description on the dataset page: https://huggingface.co/datasets/rl-rag/personalfinance-gpt-oss-120b.

sourceHugging Faceupdated 7mo agoView on Hugging Face
0likes29downloads
Dataset Card

personalfinance-gpt-oss-120b

Deep research agent evaluation on data/drtulu_personalfinance.jsonl (normal split).

Results

MetricValue
pass@40.0%
avg@40.0%
Trajectory accuracy0.0% (0/18772)
Questions4693
Trajectories18772 (4 per question)
Avg tool calls15.7
Full conversations✅

Model & Setup

Modelgpt-oss-120b
Judgegpt-4o
Max tool calls50
Temperature0.7
Blocked domainsNone

Tool Usage

ToolCalls%
browser.open167,17857%
browser.search101,09435%
browser.find18,8966%
functions.paper_search4,0511%
functions.pubmed_search980.0%

Total: 291,317 tool calls (15.7 per trajectory)

Columns

ColumnDescription
qidQuestion ID
traj_idxTrajectory index (0-3)
questionInput question
reference_answerGround truth answer
boxed_answerModel's extracted \boxed{} answer
correctGPT-4o judge verdict
judge_explanationJudge's reasoning
question_accuracyFraction of trajectories correct for this question (difficulty: 0=hardest, 1=easiest)
num_tool_callsNumber of tool calls in trajectory
tool_callsTool call log (JSON)
conversationFull trajectory with reasoning + tool responses (JSON)
contaminatedWhether search results contained evaluation dataset pages
latency_sGeneration time in seconds