TheBitCast

AI Observability: Measuring Quality, Risk, and ROI

Podcast: The Tech Trek · Elevano

Opublikowano: 2026-10-13

An AI agent can be fast, available, and still get the answer wrong. That changes what engineering teams need to measure. Jeetendra Soneja, VP of Engineering, AI Platform at iHerb, joins The Tech Trek to discuss why AI observability goes beyond traditional software monitoring. Teams need to understand not just latency and errors, but also response quality, groundedness, cost, and whether an agent completes its intended task. We also explore how to measure AI ROI without relying on misleading productivity metrics. Jeetendra shares his perspective on risk based guardrails...