# WebShop

Simulated shopping environment for instruction-following web agents.

- Catalog URL: https://awesomecua.github.io/resources/github-princeton-nlp-webshop/
- Original source: https://github.com/princeton-nlp/WebShop
- Kind: benchmark
- Review: curated
- Scope: core
- Environments: web
- Topics: evaluation, web-navigation
- Evidence checked: 2026-10-16T06:35:57Z
- ID: github:princeton-nlp/webshop

## Limitations

Inclusion does not establish reproducibility or endorsement.

- Record JSON: https://awesomecua.github.io/resources/github-princeton-nlp-webshop/record.json

## Structured profile

- actions: search queries, click actions, product option selection
- evaluation: not recorded
- focus: instruction-conditioned product selection, web navigation
- observations: HTML pages, simplified text views
- setting: interactive

### Count observations

- 12,087 instructions — crowd-sourced instruction collection (reported; source: https://raw.githubusercontent.com/princeton-nlp/WebShop/HEAD/README.md)
- ≈ 1,180,000 products — full product inventory (reported; source: https://raw.githubusercontent.com/princeton-nlp/WebShop/HEAD/README.md)

This is a simulated shop. The default preview loads 1,000 products, while the full inventory is much larger; report the loaded subset and observation mode. Instructions and products are different populations. Detailed reward semantics are not normalized in this profile.

## License declarations

- code: MIT — https://raw.githubusercontent.com/princeton-nlp/WebShop/HEAD/LICENSE.md
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://raw.githubusercontent.com/princeton-nlp/WebShop/HEAD/README.md (retrieved 2026-10-16T06:35:57Z; SHA-256 79b7a90a1413a52deb53142b5bbd81ecf40f61743bd4601c2835e91375898ec0)
- https://raw.githubusercontent.com/princeton-nlp/WebShop/HEAD/README.md (retrieved 2026-10-16T06:35:57Z; SHA-256 79b7a90a1413a52deb53142b5bbd81ecf40f61743bd4601c2835e91375898ec0)
- https://raw.githubusercontent.com/princeton-nlp/WebShop/HEAD/LICENSE.md (retrieved 2026-10-16T06:41:58Z; SHA-256 8872dbf8660b00890b5e07ce1ea1f7a44fa7ae4e1857da56caba172b51dab3cb)