Case Study: Why a High AA-Omniscience Benchmark and a Low Vectara Number Led to the Wrong Product Decision

https://speakerdeck.com/gwetervooc

How a 120-Person SaaS Company Chose Models Based on Two Numbers In March 2024 a midsize SaaS company—120 employees, $18M ARR, 10-person customer operations team—had to decide on a core model for its new customer-facing knowledge assistant