Benchmarks

SafeArena

Web-agent benchmark pairing benign and harmful tasks to study deliberate misuse risks.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

Original source ↗Read as MarkdownRecord JSON

What is this resource?

Resource type
Benchmarks
Environment
web
Topics
safety-security, evaluation
Record publication date
Not recorded
Evidence retrieved
2026-10-16T09:36:33Z
Resource ID
github:mcgill-nlp/safearena

What licenses are recorded?

Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.

Code
Not recorded
Data
Not recorded
Document
Not recorded
Weights
Not recorded

Evaluation protocol

Focus
web-agent safety, task completion
Setting
interactive
Observations
Not recorded
Actions / outputs
web interactions
Evaluation
Task outcomes and the Agent Risk Assessment categories evaluate agent behavior on benign and harmful requests.

Scale and counting units

Use SafeArena-specific containers rather than ordinary WebArena instances. The documented task splits require access approval; the profile does not imply unrestricted dataset access.

Compare source-reviewed profiles

Recorded specifications

leaderboard url
https://huggingface.co/spaces/McGill-NLP/safearena-leaderboard

Explore related topics

Safety & securityEvaluation

Related resources

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

  1. editorial primary review

    Retrieved 2026-10-16T09:36:33Z. Supports: name, kind, summary, environments, topics, scope, relations, details.benchmark_protocol, details.leaderboard_url.

    Content fingerprintae50121aa60ac26b32d8d6ad6f578f9091a81a3cb9ca28b98050bddee16c929a
  2. editorial primary review

    Retrieved 2026-10-16T06:36:54Z. Supports: details.benchmark_protocol.

    Content fingerprint4953a8e0f029016aef668bce98cec4d2873a7ae49c1fe33c4311fa5eb8d24089

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.