# ORBIT: A Framework for Multi-Agent Safety and Security Evaluations

Inspect-based framework that varies multi-agent roles, communication, attacks and defenses, with BrowserGym and virtual-desktop GUI adapters alongside coding and other tool scenarios.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2609-33102/
- Original source: https://arxiv.org/abs/2609.33102
- Kind: paper
- Review: curated
- Scope: core
- Environments: web, desktop
- Topics: evaluation, safety-security, web-navigation
- Evidence checked: 2026-10-20T13:12:28.833839+00:00
- ID: arxiv:2609.33102

## Limitations

BrowserART uses an accessibility-tree action interface, while the desktop adapter uses mouse, keyboard and screenshots. The adapted tasks are not claimed to preserve the constructs of their source benchmarks. Experiments cover a representative configuration slice with fixed attack templates; the OS-Harm results are imported from prior work using a different model and stack. Browser defense tables also differ in baseline versus defended judges and in judged benign denominators. Human judge validation used one grader. These results do not establish a universally effective defense. The linked repository and its code/data licenses were not independently inspected, and no experiment was run.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2609-33102/record.json

## Authors

Ben Hagag, William L. Anderson, Srija Chakraborty, Christian Schroeder de Witt

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2609-33102/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2609-33102/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2609.33102v1
- First submission: 2026-09-27T02:20:08Z
- Version updated: 2026-09-27T02:20:08Z
- Abstract SHA-256: 3c380079220050fbe354509238a5a79c7df2917a245490e4ec0cff512f7565ab
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?search_query=%28abs%3A%22computer-use+agents%22+OR+abs%3A%22GUI+agents%22+OR+abs%3A%22browser+agents%22+OR+abs%3A%22mobile+GUI%22%29+AND+submittedDate%3A%5B202609200000+TO+202610201255%5D&start=0&max_results=200&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-20T12:58:20.217517Z; SHA-256 f275c47a8b6d349a70e39a9e55eea5a09d99d5f35cc896100f3bcfd5b0923e0b)
- https://arxiv.org/html/2609.33102v1 (retrieved 2026-10-20T13:12:28.833839+00:00; SHA-256 3ea667f4187ba601011e5ff00c4d63676b6d9903d12b80a0d7d5dd9920f00c65)