Teams couldn't manually review hundreds of daily AI hotel calls. Audio models now evaluate raw recordings, routing exceptions to humans.
An all-in-one travel and expense management platform coordinates bookings with millions of hotels worldwide, facing a long tail of independent properties that lack modern API integrations.
To handle payments at these properties, the company deployed a voice agent to call front desks, generating hundreds of daily conversations....
“When we started to build this AI agent very quickly, what started happening was that hundreds of calls started happening on behalf of our travelers. What became very clear was that the development team, the ops team, could not hear every call to be able to learn and understand how well those calls are going.”
All-in-one travel and expense management platform that combines corporate travel booking, expense tracking, and corporate card services.
AI observability and evaluation platform that helps developers build, test, and monitor LLM-powered applications.
Navan's Call quality assurance is part of this use case:
Related implementations across industries and use cases
Scattered spreadsheets couldn't catch AI hallucinations. Now, automated LLM judges evaluate every prompt change to block regressions.
Reviewers struggled to predict how code ripples through the system. AI now flags cross-service risks that cause outages.
Developers kept hitting the same silent API pitfalls alone. One PM built a pipeline that learns from each session and shares the knowledge.
Student insights were trapped in unreviewed audio. AI securely evaluates every call to power instant feedback and proactive coaching.
Analysts audited 3% of 70k monthly tickets. AI now evaluates every interaction, reopening predicted negative cases for human agents.
Surging calls caused long holds and overtime. A 24/7 AI voice agent handles routine payroll, freeing 700 HR partners for advisory work.
Keyword bots bottlenecked 100 agents supporting millions. Now, AI resolves FAQs, freeing staff to mine chat logs for product feedback.
Protecting users from harmful on-device AI required internet. A powerful safety AI now runs directly on the PC, guarding users even when offline.
A 200% yearly data expansion bottlenecked global operations. Now, AI accelerates coding, drafts recipe cards, and resolves inquiries.
Teams couldn't manually review hundreds of daily AI hotel calls. Audio models now evaluate raw recordings, routing exceptions to humans.
An all-in-one travel and expense management platform coordinates bookings with millions of hotels worldwide, facing a long tail of independent properties that lack modern API integrations.
To handle payments at these properties, the company deployed a voice agent to call front desks, generating hundreds of daily conversations....
“When we started to build this AI agent very quickly, what started happening was that hundreds of calls started happening on behalf of our travelers. What became very clear was that the development team, the ops team, could not hear every call to be able to learn and understand how well those calls are going.”
All-in-one travel and expense management platform that combines corporate travel booking, expense tracking, and corporate card services.
AI observability and evaluation platform that helps developers build, test, and monitor LLM-powered applications.
Navan's Call quality assurance is part of this use case:
Related implementations across industries and use cases
Scattered spreadsheets couldn't catch AI hallucinations. Now, automated LLM judges evaluate every prompt change to block regressions.
Reviewers struggled to predict how code ripples through the system. AI now flags cross-service risks that cause outages.
Developers kept hitting the same silent API pitfalls alone. One PM built a pipeline that learns from each session and shares the knowledge.
Student insights were trapped in unreviewed audio. AI securely evaluates every call to power instant feedback and proactive coaching.
Analysts audited 3% of 70k monthly tickets. AI now evaluates every interaction, reopening predicted negative cases for human agents.
Surging calls caused long holds and overtime. A 24/7 AI voice agent handles routine payroll, freeing 700 HR partners for advisory work.
Keyword bots bottlenecked 100 agents supporting millions. Now, AI resolves FAQs, freeing staff to mine chat logs for product feedback.
Protecting users from harmful on-device AI required internet. A powerful safety AI now runs directly on the PC, guarding users even when offline.
A 200% yearly data expansion bottlenecked global operations. Now, AI accelerates coding, drafts recipe cards, and resolves inquiries.