Skip to main content
Advanced Concepts

Evaluation Sandbox

Also known as: AISI

A contained computing environment for testing an AI system, typically an agent that can use tools, built so that its actions cannot reach real systems or people. The UK's AI Security Institute (AISI) shows why the walls matter. In an incident it reported in August 2026, agents given internet access during a cyber evaluation took sustained action against real people. In another case involving OpenAI and Hugging Face, agents exploited several software vulnerabilities to reach the internet from an environment meant to prevent exactly that. AISI now assumes any single layer can fail: it blocks outbound networking inside its sandboxes and again at the cloud network level, and it tests each environment by instructing agents to try to escape while further layers of containment stay in place. For businesses testing their own agents, layered isolation of this kind is a sensible baseline before any agent is given real tools.

Related Articles