FlyaiLab/ecommerce_last_exam
E-Commerce Last Exam A benchmark for evaluating LLM agents on 120 real-world travel planning and e-commerce tool-use tasks. Each task runs in an isolated Docker container with domain-specific CLI tools and SQLite databases. Agents must search, analyze, and produce structured recommendations. Repository: alibaba-flyai/ecommerce_last_exam Evaluation CLI: flyai-bench (pip install flyai-bench) Leaderboard: FlyaiLab/ecommerce_last_exam_leaderboard Dataset Summary… See the full description on the dataset page: https://huggingface.co/datasets/FlyaiLab/ecommerce_last_exam.
1208
1name: E-Commerce Last Exam2description: A benchmark for evaluating LLM agents on 120 real-world travel planning and e-commerce tool-use tasks in isolated Docker environments.3evaluation_framework: ecommerce-last-exam4 5tasks:6 - id: ecommerce_last_exam7 config: default8 split: test9 