birdsql/usersim-guard-v1.5

🌐 Website • 📄 Paper • 💻 BIRD-Interact 🛡️ Overview: USERSIM-GUARD USERSIM-GUARD is a benchmark designed to evaluate the safety, reliability, and robustness of User Simulators in interactive Text-to-SQL environments. As proposed in the BIRD-Interact paper, a high-quality User Simulator must not only be helpful but also "guarded", which means it should provide helpful responses while refusing to leak sensitive information (like solution ideas, database schema details, or… See the full description on the dataset page: https://huggingface.co/datasets/birdsql/usersim-guard-v1.5.