Containment Is Lying to You: Measuring AI Agents Like Employees — Druid AI

Two AI interns. One handles 96% of conversations alone, the other only 80%. The dashboard picks the wrong one. Druid AI's team, including co-founder and chief product officer Dan Bălăceanu, shows why containment rate, the metric on every agent dashboard, can point you to the wrong agent. In their bank example, the intern who escalated more often was handing senior bankers customers who were about to refinance. They walk through a performance review framework built with their customers: seven pillars split into what the agent is configured with and what it does at runtime, with governance across both. Twenty-six components are each scored 0, 1 or 2 (missing, defined, or actually governed and tracked over time) and weighted by business impact, with governance and mandate weighted highest. They cover error tolerance, risk, compliance, observability, drift, hallucination, tone and sentiment, the agent's mandate, scope, business case and budget, a shared platform, and validating outcomes. They also show a dashboard that stays green all year while the agent's real score slides from 83% to 60%, how to answer the ROI question, and why containment targets differ by industry in Druid's 2026 AI Adoption Benchmark. In this talk: • Why containment rate can reward the wrong agent • A seven-pillar scorecard: configuration, runtime and governance • Scoring and weighting 26 components by business impact • Answering ROI and setting industry-specific targets SPEAKER Dan Bălăceanu, Co-founder & Chief Product Officer, Druid AI LinkedIn: https://www.linkedin.com/in/dan-balaceanu/ LINKS Druid AI: https://www.druidai.com Druid 2026 AI Adoption Benchmark: https://www.druidai.com/ai-adoption-benchmark CHAPTERS 0:00 Intro 1:36 Two interns, one dashboard 3:09 The containment trap 3:33 The seven-pillar framework 5:42 Scoring: 0, 1 or 2 7:12 Weighting by business impact 8:56 Governance: tolerance and risk 11:30 The agent's mandate 13:25 Platform 16:07 Validating outcomes 16:26 The final score 17:25 Recap 18:20 Green dashboard, falling score 18:50 The ROI question 20:00 Targets differ by industry Recorded at the AI Engineer World's Fair 2026 in San Francisco. Subscribe for more talks from the engineers building…