--- title: "Vector Indexes Are Not Interchangeable. Most Applications Treat Them Like They Are." url: https://daily.dev/posts/vector-indexes-are-not-interchangeable-most-applications-treat-them-like-they-are--0c2jnpspp source_url: https://www.couchbase.com/blog/vector-indexes-are-not-interchangeable-most-applications-treat-them-like-they-are type: article source: "Couchbase" published: 2026-08-11T16:01:32.784Z updated: 2026-08-11T16:02:07.101Z tags: ["vector-search", "couchbase"] reading_time: 12 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Vector Indexes Are Not Interchangeable. Most Applications Treat Them Like They Are. **[Couchbase](https://daily.dev/sources/couchbase)** · 12 min read · 0 upvotes · 0 comments ## Summary Vector index configuration is one of the most consequential and least revisited decisions in semantic search systems. The post explains why creating a vector index is an architectural commitment — locking in memory model, compression scheme, and query syntax — and why changing it later is expensive. It covers the three-way tension between recall, latency, and cost, then details three Couchbase index types (Hyperscale, Composite, and FTS Search Vector Index), each suited to different scale and filter patterns. Common failure modes are described: the simplicity trap (picking FTS and hitting memory limits at 130M+ vectors), the scale-fixation trap (choosing Hyperscale when filter-first would be faster), and codebook drift (IVF centroids becoming unrepresentative as data evolves, silently degrading recall). A decision framework based on keyword needs, scale thresholds, filter selectivity, and growth projections is outlined, along with a Couchbase Vector Index Advisor tool that guides teams through the diagnostic questions before writing a CREATE statement. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is codebook drift in IVF vector indexes and how do I fix it? Codebook drift occurs when an IVF-based vector index trains its cluster centroids on a data sample taken at build time, and new data flowing in diverges from that original sample. The centroids stop being representative, and recall slowly decays with no error or alert — results just get gradually worse. The fix is a periodic index rebuild, which is straightforward once you know the hazard exists. _Teams running long-lived vector indexes track recall degradation patterns like this on daily.dev._ ### What are the memory requirements for a Composite Vector Index with 100M vectors at 1536 dimensions using SQ8 quantization? At 100M vectors with 1536 dimensions, the quantized vector payload alone using SQ8 (one byte per dimension) is roughly 144 GB before accounting for centroids, graph structure, and scalar columns. The Index Service must keep the working set resident in its memory quota; if pushed past that quota, it stops serving scans until memory is freed. _Developers sizing vector infrastructure for production workloads find real benchmark comparisons on daily.dev._ ### When should I use an IVF Composite vector index versus a Hyperscale vector index? Use a Composite index when queries carry narrow scalar filters that keep only a thin slice of the corpus eligible — the filter-first execution means expensive nearest-neighbor work runs over a small subset rather than the full dataset, making it the right choice for multi-tenant applications and strongly partitioned catalogs. Use a Hyperscale index when filters are broad or absent, or when the dataset exceeds 100M vectors and memory constraints rule out keeping vectors resident in RAM. _Engineers deciding between vector index architectures for their stack follow these trade-offs on daily.dev._ ## Similar posts on daily.dev - [The Case Against pgvector](https://daily.dev/posts/the-case-against-pgvector-amqbtam6f) · Hacker News · 3 upvotes · 0 comments - [Filtered ANN Search With Composite Vector Indexes](https://daily.dev/posts/filtered-ann-search-with-composite-vector-indexes-e9pxmr9n7) · Couchbase · 0 upvotes · 0 comments - [Scaling Vector Search Performance: From Millions to Billions](https://daily.dev/posts/scaling-vector-search-performance-from-millions-to-billions-c5dvchkfu) · BigData Boutique blog · 3 upvotes · 0 comments --- Tags: [#vector-search](https://daily.dev/tags/vector-search), [#couchbase](https://daily.dev/tags/couchbase) [View this post on daily.dev](https://daily.dev/posts/vector-indexes-are-not-interchangeable-most-applications-treat-them-like-they-are--0c2jnpspp)