Campbell Brown, former Facebook news chief and founder of Forum AI, is building a company that evaluates how AI foundation models handle high-stakes topics like geopolitics, mental health, and hiring. Forum AI recruits domain experts (including Niall Ferguson, Fareed Zakaria, and Tony Blinken) to architect benchmarks, then trains AI judges to evaluate models at scale, targeting ~90% consensus with human experts. Brown's evaluations found troubling issues across leading models: political bias, sourcing from CCP websites for unrelated stories, missing context, and straw-manned arguments. She argues AI companies prioritize coding and math over news accuracy, and that current compliance audits are inadequate. Forum AI, which raised $3M from Lerer Hippeau, is betting on enterprise demand — companies making credit, hiring, and insurance decisions that need accurate, auditable AI outputs. Brown sees a stark gap between Silicon Valley's optimism about AI and the 'slop and wrong answers' everyday users still encounter.

4m read timeFrom techcrunch.com
Post cover image
219 Impressions