Netguru
Read post

RAG chatbot accuracy: how data preparation beat model size

A RAG chatbot built for a network of 25,000+ implant dentistry specialists achieved 98% accuracy and near-zero hallucinations using GPT-5 mini — a deliberately small model. The key insight: in RAG systems, accuracy is determined by data preparation and retrieval quality, not model size. The engineering effort went into rigorous source cleaning (handling clinical abbreviations, measurement formats, hyphenated breaks), empirically-tested chunk sizing (1,000–1,250 tokens to keep complete answers intact), strict prompt constraints (no fabrication, brand-neutral, scope-limited), and a golden dataset evaluation pipeline using Promptfoo and Langfuse. User testing with 24 specialists and a 31-member survey returned an NPS of 81, with 23 of 24 specialists clearly preferring it over general chatbots due to traceable, vetted citations.

    #data-science#llm#bots#rag#vector-search
Jul 28•11m read time•From netguru.com
Post cover image
Table of contents
Bigger model or better data? What a RAG chatbot actually rewardsWhat the medical benchmarks say about RAGWhat we built: a healthcare chatbot grounded in evidenceWhy a small LLM held up in productionWhere the chatbot accuracy actually comes from - data preparationHow we measured near-zero AI hallucinationsWhat building a RAG chatbot this way proves
1 Impression
Netguru's image
Netguru

Netguru is a digital consultancy and software development company that shares insights, case studies...

191 Followers

•

2.9K Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard