---
title: "Notion scaled its vector database by 10x."
url: https://daily.dev/posts/notion-scaled-its-vector-database-by-10x--lkqa2n49a
source_url: https://www.youtube.com/watch?v=LtpKwnFFgNU
type: video:youtube
source: "Gaurav Sen"
published: 2026-07-03T20:16:52.661Z
updated: 2026-07-03T20:17:10.326Z
tags: ["vector-search", "apache-spark", "apache-kafka"]
reading_time: 1
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Notion scaled its vector database by 10x.

**[Gaurav Sen](https://daily.dev/sources/gkcs)** · 1 min read · 0 upvotes · 0 comments

## Summary

Notion scaled its vector search infrastructure to 10x capacity at one-tenth the original cost through several engineering optimizations. Documents are chunked via Apache Spark batch jobs and embeddings are stored in a vector database, with Kafka handling real-time updates. Key improvements include: chunk hashing to skip unchanged content on edits (reducing unnecessary updates), splitting chunks into metadata and textual content to avoid full re-embedding on permission changes (70% data volume reduction), tuning Apache Spark for tens of thousands of workspaces daily, moving to a serverless architecture (50% cost reduction), and migrating to Ray for unified CPU/GPU processing on the same node (anticipated 90% embedding cost reduction).

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://www.youtube.com/watch?v=LtpKwnFFgNU>

## Similar posts on daily.dev

- [How HubSpot Scaled Semantic Search to 20 Billion Vectors](https://daily.dev/posts/how-hubspot-scaled-semantic-search-to-20-billion-vectors-vykkjoxfy) · InfoQ · 1 upvotes · 0 comments
- [Decoupled by Design: Billion-Scale Vector Search](https://daily.dev/posts/decoupled-by-design-billion-scale-vector-search-puyxn3eah) · databricks · 26 upvotes · 0 comments

---

Tags: [#vector-search](https://daily.dev/tags/vector-search), [#apache-spark](https://daily.dev/tags/apache-spark), [#apache-kafka](https://daily.dev/tags/apache-kafka)

[View this post on daily.dev](https://daily.dev/posts/notion-scaled-its-vector-database-by-10x--lkqa2n49a)
