--- title: "Faster AI Responses with Semantic Caching in Azure Managed Redis | OD823" url: https://daily.dev/posts/faster-ai-responses-with-semantic-caching-in-azure-managed-redis-od823-mcsjh5end source_url: https://www.youtube.com/watch?v=QQXnwN302n8 type: video:youtube source: "Microsoft Developer" published: 2026-06-03T13:34:28.622Z updated: 2026-06-03T13:34:57.136Z tags: ["llm", "ai-agents"] reading_time: 30 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Faster AI Responses with Semantic Caching in Azure Managed Redis | OD823 **[Microsoft Developer](https://daily.dev/sources/microsoftdeveloper)** · 30 min read · 0 upvotes · 0 comments ## Summary Azure Managed Redis (AMR) can significantly reduce LLM token costs and improve AI response times through semantic caching and agent memory. Unlike traditional exact key-value caching, semantic caching uses vector embeddings and cosine similarity search to match semantically equivalent prompts, serving cached responses without calling the LLM. A live demo shows cache hits on rephrased queries, configurable similarity thresholds, per-user vs. global cache namespacing to prevent data leakage, and a cost calculator showing ~70% savings at a 70% cache hit rate. A second demo covers agent memory: short-term conversation history and long-term user facts (preferences, interests, work) are stored in AMR with TTLs, enabling personalized multi-agent workflows where agents share durable context rapidly without repeated LLM calls. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Implementing Semantic Caching Using Spring AI](https://daily.dev/posts/implementing-semantic-caching-using-spring-ai-anojohlzl) · Baeldung · 4 upvotes · 0 comments - [Semantic memory search for AI agents](https://daily.dev/posts/semantic-memory-search-for-ai-agents-rulp67gur) · Redis · 0 upvotes · 0 comments - [Why smarter AI caching sometimes makes everything slower](https://daily.dev/posts/why-smarter-ai-caching-sometimes-makes-everything-slower-4ipuhnzma) · The New Stack · 1 upvotes · 0 comments - [Zero-Waste Agentic RAG: Designing Caching Architectures to Minimize Latency and LLM Costs at Scale](https://daily.dev/posts/zero-waste-agentic-rag-designing-caching-architectures-to-minimize-latency-and-llm-costs-at-scale-iltgltc8x) · Towards Data Science · 1 upvotes · 0 comments --- Tags: [#llm](https://daily.dev/tags/llm), [#ai-agents](https://daily.dev/tags/ai-agents) [View this post on daily.dev](https://daily.dev/posts/faster-ai-responses-with-semantic-caching-in-azure-managed-redis-od823-mcsjh5end)