CoolFace
Datasetpublic

connections-dev/rag-agentic-haiku-hard20-20260318-151930

rag-agentic-haiku-hard20 Run timestamp: 2026-03-18T15:19:30 Benchmark: CREATE — associative reasoning via knowledge-graph path generation Run Parameters Parameter Value Mode rag_agentic Generator model claude-haiku-4-5-20251001 Temperature None Max tokens 4096 Run Summary Metric Value Instances processed 20 Total paths generated 240 Avg paths / instance 12.00 Min paths / instance 0 Max paths / instance 18… See the full description on the dataset page: https://huggingface.co/datasets/connections-dev/rag-agentic-haiku-hard20-20260318-151930.

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes6downloads
Dataset Card

rag-agentic-haiku-hard20

Run timestamp: 2026-03-18T15:19:30 Benchmark: CREATE — associative reasoning via knowledge-graph path generation

Run Parameters

ParameterValue
Moderag_agentic
Generator modelclaude-haiku-4-5-20251001
TemperatureNone
Max tokens4096

Run Summary

MetricValue
Instances processed20
Total paths generated240
Avg paths / instance12.00
Min paths / instance0
Max paths / instance18
Total cost (USD)$0.3807

Dataset Format

Each row contains:

  • —query — the original CREATE benchmark query string
  • —path_prediction — list of path strings, each a JSON array of [head, relation, tail] triples
  • —cost_usd — LLM API cost for this instance in USD
  • —All original CREATE fields (metadata, prompting_information, etc.)

Generated by [create_solver](https://github.com/ManyaWadhwa/create_solver)