CoolFace
Datasetpublic

thorvspheonix/voice-agent-qa-home-services-free

Voice Agent QA Lab: public sample Ten authored, synthetic scenarios for evaluating home-service voice-agent behavior. This is a scenario library, not transcripts of real callers, a model leaderboard, or evidence of vendor failure. Try the scorecard Schema case_id: string vertical: string category: string severity: string caller_utterance: string business_context: string available_tools: list of strings expected_action: string forbidden_actions: list of strings… See the full description on the dataset page: https://huggingface.co/datasets/thorvspheonix/voice-agent-qa-home-services-free.

sourceHugging Facecc-by-4.0updated 3d agoView on Hugging Face
0likes42downloads
Dataset Card

Voice Agent QA Lab: public sample

Ten authored, synthetic scenarios for evaluating home-service voice-agent behavior. This is a scenario library, not transcripts of real callers, a model leaderboard, or evidence of vendor failure.

Try the scorecard

Schema

  • —case_id: string
  • —vertical: string
  • —category: string
  • —severity: string
  • —caller_utterance: string
  • —business_context: string
  • —available_tools: list of strings
  • —expected_action: string
  • —forbidden_actions: list of strings
  • —expected_result: string
  • —failure_conditions: list of strings

The caller utterance and business context define the case; expected and prohibited behaviors form the review rubric. IDs and severity organize review. Use JSONL for dataset loading; JSON and CSV provide alternative formats of the same ten rows.

Intended use and limitations

Manual review and user-built testing workflows. No verified native importer, hosted runner, audio benchmark, or measured pass rate. Human review is needed for ambiguous evidence and business-specific rules. The small sample is not statistically representative of production calls or safety outcomes.

Provenance and license

Authored for Voice Agent QA Lab. Version 1.1.0, 2026-09-23. No personal or customer transcripts.

HVAC-001, HVAC-007, HVAC-011, Plumbing-004, Plumbing-015, Electrical-006, Electrical-014, Electrical-021, Roofing-006, Roofing-024 are licensed under CC BY 4.0, including commercial reuse and adaptation with attribution. The other 90 paid cases are not included or relicensed. Voice Agent QA Lab — Home Services Starter Edition, https://voice-agent-qa-lab.vercel.app, CC BY 4.0. Indicate changes if adapted.

Optional full pack

100 structured scenarios: 25 each for HVAC, Plumbing, Electrical, Roofing. JSONL, CSV, and an offline review viewer. $19 USD once. Client-agent testing included.

Product and purchase. One purchaser or purchasing organization may use and adapt the pack to test its own agents and agents it builds or manages for clients, and share findings and reports with those clients. Redistribution, resale, sublicensing, or publication of the paid library or a substantially equivalent replacement is prohibited.