# WebSuite: Systematically Evaluating Why Web Agents Fail

WebSuite organizes browser operations into an action taxonomy and tests both isolated controls and complete workflows. Its diagnostic tasks attribute failures to specific actions, enabling comparison of text-based and multimodal web agents.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2406-01623/
- Original source: https://arxiv.org/abs/2406.01623
- Kind: paper
- Review: curated
- Scope: core
- Environments: web
- Topics: evaluation, observability, web-navigation
- Evidence checked: 2026-10-16T06:36:58Z
- ID: arxiv:2406.01623

## Limitations

The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2406-01623/record.json

## Authors

Eric Li, Jim Waldo

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2406-01623/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2406-01623/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2406.01623v1
- First submission: 2024-06-01T00:32:26Z
- Version updated: 2024-06-01T00:32:26Z
- Abstract SHA-256: b9a728edf0b834adb72abfc50e13d5b2b52f532f444b3e8af34effd3d86beb1b
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22%29+AND+submittedDate%3A%5B200001010000+TO+202610160636%5D&start=800&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-16T06:36:58Z; SHA-256 c87e97eb397da04806d53145cf9c13be739fc657bb54dca9318c8c4ed2a36249)
- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22%29+AND+submittedDate%3A%5B200001010000+TO+202610160636%5D&start=800&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-16T06:36:58Z; SHA-256 c87e97eb397da04806d53145cf9c13be739fc657bb54dca9318c8c4ed2a36249)