Healthcare AI performance can't be measured reliably through aggregate metrics alone. Drawing on experience across multiple clinical specialties, this article argues that oncology, interventional cardiology, clinical pharmacy, and primary care each exhibit unique failure modes driven by evidence velocity, retrieval precision, interaction density, and cross-specialty complexity. The solution is specialty-aware architecture, retrieval, monitoring, and evaluation frameworks that surface failures be...