Enterprise AI is entering an evaluation gap: Agents are gaining autonomy faster than companies can verify them

A June 2026 VB Pulse survey of 157 enterprise respondents found that half have shipped an AI agent or LLM feature that passed internal evaluations but still caused a customer-facing failure. Despite this, 66% allow or are building toward production deployments without human review, while only 5% fully trust their automated evaluations, exposing a widening evaluation gap.

The findings suggest enterprise AI adoption is moving from experimentation to operational risk, where traditional software testing cannot keep up with agents that take multi-step actions and use tools autonomously. This points to rising demand for AI governance infrastructure around evaluation, identity, cost controls, context management, and orchestration as companies retrofit safeguards after deployment.