Calibration (AI)

The accuracy with which an AI system's expressed confidence levels match its actual performance, enabling users to appropriately trust or question AI outputs based on stated certainty. Well-calibrated AI systems exhibit reliable confidence scores where 90% confidence predictions prove correct approximately 90% of the time, whilst poorly calibrated systems may express high confidence in incorrect answers. Businesses relying on AI decision support need calibrated systems to make informed judgments about when to trust AI recommendations versus seeking human verification. Applications include risk assessment tools where confidence scores guide escalation decisions, customer service systems where AI indicates when human intervention is needed, and automated decision systems where calibration determines appropriate autonomy levels.