ianalloway/browser-agent-benchmark

The browser is the real agent benchmark

Most agent demos skip the part that breaks in production: real websites.

This Space is a small public companion to Ian Alloway's write-up on real-world browser agents, publishing automation, and why "I clicked the button" is not enough unless the system leaves a receipt.

Read the full post: https://allowayai.substack.com/p/the-browser-is-the-real-agent-benchmark

What this benchmark cares about

A useful browser agent should survive the things modern web apps actually do:

• —authenticated persistent browser profiles;
• —MFA / CAPTCHA / human handoff without leaking credentials;
• —iframe and Shadow DOM traversal;
• —rich-text editors like ProseMirror and Quill;
• —native passkey/WebAuthn prompts that sit outside the DOM;
• —final-state verification instead of trusting a successful process exit;
• —locked-down remote desktop exposure after manual auth.

Receipts over vibes

The bar is simple: if the agent claims it posted, submitted, updated, or paid for something, it should produce a concrete receipt: a final URL, a DOM state, a server response, a public page check, or a screenshot.

That is the difference between a chatbot and infrastructure.

Links

• —Substack: https://allowayai.substack.com/p/the-browser-is-the-real-agent-benchmark
• —GitHub: https://github.com/ianalloway
• —Portfolio: https://ianalloway.xyz