---
title: "Beyond the Menu Tree: How Yelp Built a Smarter Customer Success Chatbot with AI"
url: https://daily.dev/posts/beyond-the-menu-tree-how-yelp-built-a-smarter-customer-success-chatbot-with-ai-m3kbyzylj
source_url: https://engineeringblog.yelp.com/2026/05/beyond-menu-tree.html
type: article
source: "Yelp Engineering"
published: 2026-05-27T21:07:49.270Z
updated: 2026-05-27T21:25:02.354Z
tags: ["llm", "bots", "rag", "vector-search"]
reading_time: 9
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Beyond the Menu Tree: How Yelp Built a Smarter Customer Success Chatbot with AI

**[Yelp Engineering](https://daily.dev/sources/yelp)** · 9 min read · 0 upvotes · 0 comments

## Summary

Yelp replaced its legacy rule-based customer support chatbot with an LLM-assisted system powered by a RAG pipeline. The new system routes queries into five specialized workflows (QA, Billing, Refund, Cancel, Review). The RAG pipeline uses metadata-only embeddings (title, summary, headers) from ~370 support articles rather than full-text or chunked content, which proved more accurate for semantic matching. FAISS is used for fast similarity search, achieving ~94% recall@5. A daily batch job keeps the vectorstore fresh via AWS S3. Key challenges included LLM hallucination of hyperlinks, addressed with dedicated validation. The system doubled the chatbot resolution rate in A/B testing.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://engineeringblog.yelp.com/2026/05/beyond-menu-tree.html>

## Similar posts on daily.dev

- [How Yelp Built “Yelp Assistant”](https://daily.dev/posts/how-yelp-built-yelp-assistant--n1qvkuztz) · ByteByteGo · 3 upvotes · 0 comments
- [Our Early Journey to Transform Instacart’s Discovery Recommendations with LLMs](https://daily.dev/posts/our-early-journey-to-transform-instacart-s-discovery-recommendations-with-llms-wpv1ryxzx) · Instacart · 1 upvotes · 0 comments
- [Chatbot customer support: Automation framework & implementation guide](https://daily.dev/posts/chatbot-customer-support-automation-framework-implementation-guide-tah4qy5tm) · Netguru · 0 upvotes · 0 comments

---

Tags: [#llm](https://daily.dev/tags/llm), [#bots](https://daily.dev/tags/bots), [#rag](https://daily.dev/tags/rag), [#vector-search](https://daily.dev/tags/vector-search)

[View this post on daily.dev](https://daily.dev/posts/beyond-the-menu-tree-how-yelp-built-a-smarter-customer-success-chatbot-with-ai-m3kbyzylj)