Latency

The time delay between submitting a request to an AI system and receiving its response, critical for user experience and operational efficiency in business applications. High latency can disrupt customer interactions, slow business processes, and reduce the practical value of AI implementations. Businesses must balance AI capability requirements with acceptable response times, particularly for customer-facing applications, real-time decision-making, and interactive services. Optimising latency involves considerations of model complexity, computational infrastructure, data processing efficiency, and network performance to ensure AI systems meet business operational requirements.