---
title: "Boost Performance and Lower Costs with AlloyDB AI Functions"
url: https://daily.dev/posts/boost-performance-and-lower-costs-with-alloydb-ai-functions-cvsjukeo1
source_url: https://cloud.google.com/blog/products/databases/boost-performance-and-lower-costs-with-alloydb-ai-functions
type: article
source: "Google Cloud"
published: 2026-07-01T18:17:29.227Z
updated: 2026-08-24T08:21:44.545Z
tags: ["llm", "backend", "gcp", "vector-search", "alloydb"]
reading_time: 7
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Boost Performance and Lower Costs with AlloyDB AI Functions

**[Google Cloud](https://daily.dev/sources/gcp)** · 7 min read · 0 upvotes · 0 comments

## Summary

AlloyDB now offers new AI functions and major performance improvements for running LLM calls directly within SQL queries. Three new functions are introduced: ai.summarize, ai.agg_summarize, and ai.analyze_sentiment, joining the existing GA functions (ai.generate, ai.rank, ai.if, ai.forecast). Two key performance breakthroughs are highlighted: Smart Batching, which intelligently groups AI function calls to reduce prompt overhead and achieve up to 2,400x throughput improvement; and Optimized AI Functions, which train a lightweight proxy model on your data to process decisions locally, achieving up to 100,000 rows/sec (23,000x improvement) and 6,000x cost reduction. Both features are currently in preview for ai.if and ai.rank.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://cloud.google.com/blog/products/databases/boost-performance-and-lower-costs-with-alloydb-ai-functions>

## Similar posts on daily.dev

- [AlloyDB Ships Proxy Models That Replace LLM Calls with Local Inference Inside the Database](https://daily.dev/posts/alloydb-ships-proxy-models-that-replace-llm-calls-with-local-inference-inside-the-database-4vvzzcrji) · InfoQ · 1 upvotes · 0 comments
- [Using AI\_Functions in Your Data Warehouse: Top Use Cases](https://daily.dev/posts/using-ai-functions-in-your-data-warehouse-top-use-cases-om2ogbtjk) · databricks · 1 upvotes · 0 comments

---

Tags: [#llm](https://daily.dev/tags/llm), [#backend](https://daily.dev/tags/backend), [#gcp](https://daily.dev/tags/gcp), [#vector-search](https://daily.dev/tags/vector-search), [#alloydb](https://daily.dev/tags/alloydb)

[View this post on daily.dev](https://daily.dev/posts/boost-performance-and-lower-costs-with-alloydb-ai-functions-cvsjukeo1)