# DSAgentBench: Can Agents Automate End-to-End Data-Science Workflows in Real Computer Environments?

DSAgentBench evaluates end-to-end data-science workflows spanning analysis, modeling and visualization inside a real desktop environment. Task evaluators check produced analytical and visual artifacts, while the released interface supports screenshot or accessibility observations and GUI actions.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2608-10366/
- Original source: https://arxiv.org/abs/2608.10366
- Kind: paper
- Review: curated
- Scope: core
- Environments: desktop, linux
- Topics: evaluation, workflow, science, long-horizon
- Evidence checked: 2026-10-16T06:33:09Z
- ID: arxiv:2608.10366

## Limitations

The paper abstract and official project README were reviewed. The README documents an Ubuntu desktop and GUI action interface and includes LLM-assisted evaluators; this annotation does not assert that every evaluator is deterministic. Experimental results and released artifacts have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2608-10366/record.json

## Authors

Mizanur Rahman, Mohammed Saidul Islam, Ridwan Mahbub, Md Tahmid Rahman Laskar, Shafiq Joty, Enamul Hoque Prince

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2608-10366/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2608-10366/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2608.10366v1
- First submission: 2026-08-11T01:45:56Z
- Version updated: 2026-08-11T01:45:56Z
- Abstract SHA-256: e1089e57e0f0146f29a4a411c5c6f72da3c9f45be223fbbc5c9630315be6a680
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2607.05277%2C2607.06118%2C2607.06306%2C2607.07820%2C2607.11185%2C2607.11388%2C2607.12625%2C2607.12640%2C2607.13027%2C2607.14277%2C2607.14443%2C2607.14548%2C2607.15193%2C2607.15550%2C2607.17050%2C2607.18046%2C2607.19865%2C2607.21557%2C2607.22798%2C2607.23263%2C2607.24112%2C2607.24167%2C2607.25904%2C2607.26041%2C2607.27155%2C2607.28074%2C2607.28227%2C2607.28609%2C2607.29320%2C2608.01964%2C2608.02352%2C2608.02643%2C2608.03270%2C2608.03327%2C2608.04530%2C2608.04741%2C2608.05587%2C2608.05784%2C2608.05891%2C2608.06065%2C2608.06171%2C2608.06477%2C2608.09278%2C2608.09654%2C2608.10366%2C2608.10692%2C2608.11588%2C2608.12429%2C2608.15930%2C2608.17310&max_results=50 (retrieved 2026-10-16T06:33:09Z; SHA-256 65cc3856c70a0fb267f9996872e077de10e9f54821ab1ffb1d82f0a92fa11dbf)
- https://export.arxiv.org/api/query?id_list=2607.05277%2C2607.06118%2C2607.06306%2C2607.07820%2C2607.11185%2C2607.11388%2C2607.12625%2C2607.12640%2C2607.13027%2C2607.14277%2C2607.14443%2C2607.14548%2C2607.15193%2C2607.15550%2C2607.17050%2C2607.18046%2C2607.19865%2C2607.21557%2C2607.22798%2C2607.23263%2C2607.24112%2C2607.24167%2C2607.25904%2C2607.26041%2C2607.27155%2C2607.28074%2C2607.28227%2C2607.28609%2C2607.29320%2C2608.01964%2C2608.02352%2C2608.02643%2C2608.03270%2C2608.03327%2C2608.04530%2C2608.04741%2C2608.05587%2C2608.05784%2C2608.05891%2C2608.06065%2C2608.06171%2C2608.06477%2C2608.09278%2C2608.09654%2C2608.10366%2C2608.10692%2C2608.11588%2C2608.12429%2C2608.15930%2C2608.17310&max_results=50 (retrieved 2026-10-16T06:33:09Z; SHA-256 65cc3856c70a0fb267f9996872e077de10e9f54821ab1ffb1d82f0a92fa11dbf)
- https://github.com/vis-nlp/DSAgentBench (retrieved 2026-10-17T04:06:26Z; SHA-256 2158cabc9a6211e0b75e8e3307f80ebc0d42c42fccc03d0143dcf574c2f663db)