<!-- mobian-agent-page publisher="dailydev" canonical="https://daily.dev/sources/databricks/best-of/2025" -->

---
title: Best databricks posts of 2025 | daily.dev
description: The most upvoted databricks posts of 2025, curated by the daily.dev community.
canonical: https://daily.dev/sources/databricks/best-of/2025
twitter:card: summary_large_image
twitter:site: @dailydotdev
og:url: https://daily.dev/sources/databricks/best-of/2025
og:type: website
og:site_name: daily.dev
og:title: Best databricks posts of 2025 | daily.dev
og:description: The most upvoted databricks posts of 2025, curated by the daily.dev community.
og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph
---

# Best of databricks — 2025

1. 1  
[](/posts/building-custom-llm-judges-for-ai-agent-accuracy-phlvzjknk "Building Custom LLM Judges for AI Agent Accuracy")  
[![databricks's profile](https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/fa7aa720f2db4d1eba826814730482c8)](/sources/[source]/best-of/[year])  
6m read time • Nov 04, 2025  
### Building Custom LLM Judges for AI Agent Accuracy  
MLflow introduces three new capabilities for evaluating AI agents: Tunable Judges for creating custom LLM evaluators using natural language instructions, Agent-as-a-Judge for automatically identifying relevant trace data without manual parsing, and Judge Builder for visual judge management with domain expert feedback. These tools enable teams to build domain-specific evaluation criteria, align judges with human feedback through continuous tuning, and scale quality assessment from prototype to production. The make\_judge SDK simplifies creating custom judges, while alignment optimization incorporates subject matter expert feedback to improve evaluation accuracy over time.

+4  
![Post Cover image](https://media.daily.dev/image/upload/t_mobile_feed/v1/posts/4f75f62adf247ef606f6780e4687c5ba?_a=AQAEulh)  
55  
2
2. 2  
[](/posts/the-new-way-to-build-pipelines-on-databricks-introducing-the-ide-for-data-engineering-qovhr2fcm "The New Way to Build Pipelines on Databricks: Introducing the IDE for Data Engineering")  
[![databricks's profile](https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/fa7aa720f2db4d1eba826814730482c8)](/sources/[source]/best-of/[year])  
4m read time • Nov 19, 2025  
### The New Way to Build Pipelines on Databricks: Introducing the IDE for Data Engineering  
Databricks launched the IDE for Data Engineering in Public Preview, a dedicated development environment for building declarative data pipelines within the Databricks Workspace. The IDE provides an integrated experience with features like automatic dependency graph visualization, file-based dataset organization, built-in data previews, debugging tools, and Git integration. It supports the declarative programming paradigm where developers specify what they want to achieve rather than how to build it, with the editor handling execution planning and optimization. The tool consolidates pipeline authoring, testing, version control, and scheduling into a single interface, aiming to improve developer productivity and reduce context switching.

+4  
![Post Cover image](https://media.daily.dev/image/upload/t_mobile_feed/v1/posts/f15a135086b9e2d4457309b77e36ed95?_a=AQAEulh)  
44
3. 3  
[](/posts/introducing-apache-spark-4-0-psljz0xce "Introducing Apache Spark 4.0")  
[![databricks's profile](https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/fa7aa720f2db4d1eba826814730482c8)](/sources/[source]/best-of/[year])  
13m read time • May 28, 2025  
### Introducing Apache Spark 4.0  
Apache Spark 4.0 introduces key advancements in SQL language, Python support, structured streaming, and usability, enhancing big data processing. Notable features include improved multi-language compatibility, new SQL scripting capabilities, enhanced Python APIs, and structured logging. This release offers greater modularity, scalability, and standards compliance, making it future-ready for large-scale data analytics.

+5  
![Post Cover image](https://media.daily.dev/image/upload/t_mobile_feed/v1/posts/3fb73f9c4f95a84c563d4593ba485d7c?_a=AQAEuj9)  
43
4. 4  
[](/posts/architecting-a-high-concurrency-low-latency-data-warehouse-on-databricks-that-scales-kmkz9e2pb "Architecting a High-Concurrency, Low-Latency Data Warehouse on Databricks That Scales")  
[![databricks's profile](https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/fa7aa720f2db4d1eba826814730482c8)](/sources/[source]/best-of/[year])  
29m read time • Sep 02, 2025  
### Architecting a High-Concurrency, Low-Latency Data Warehouse on Databricks That Scales  
A comprehensive guide to building high-performance data warehouses on Databricks that handle hundreds of concurrent users with sub-second query response times. Covers architectural best practices including SQL Serverless Warehouses, Liquid Clustering, Unity Catalog governance, and AI-powered optimizations. Provides a structured framework for assessment, implementation, and monitoring, with real-world case study showing how an email marketing platform reduced costs while improving performance through materialized views and modern data organization techniques.

+5  
![Post Cover image](https://media.daily.dev/image/upload/t_mobile_feed/v1/posts/9ee6f69e2e7e75489db30f646c7d24d4?_a=AQAEulh)  
31
5. 5  
[](/posts/build-high-quality-domain-specific-agents-at-95-lower-cost-d33ay3rq1 "Build High-Quality, Domain-Specific Agents at 95% Lower Cost")  
[![databricks's profile](https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/fa7aa720f2db4d1eba826814730482c8)](/sources/[source]/best-of/[year])  
3m read time • Oct 15, 2025  
### Build High-Quality, Domain-Specific Agents at 95% Lower Cost  
Databricks introduces token-based pricing for MLflow GenAI evaluation, reducing costs by up to 95% compared to fixed-block pricing. The platform now supports custom judges using any LLM provider (OpenAI, Anthropic, or fine-tuned models) and open-sources production-tested evaluation prompts validated across finance, healthcare, and technical documentation domains. Teams can evaluate agents across metrics like correctness, faithfulness, relevance, and safety while maintaining full control over evaluation logic and scaling to production workloads.

+4  
![Post Cover image](https://media.daily.dev/image/upload/t_mobile_feed/v1/posts/8c068daf7b055f0a605fb616dc12cf9a?_a=AQAEulh)  
21
6. 6  
[](/posts/announcing-lakeflow-designer-no-code-etl-powered-by-the-databricks-intelligence-platform-udxwiw3ea "Announcing Lakeflow Designer: No-Code ETL, Powered by the Databricks Intelligence Platform")  
[![databricks's profile](https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/fa7aa720f2db4d1eba826814730482c8)](/sources/[source]/best-of/[year])  
4m read time • Jun 12, 2025  
### Announcing Lakeflow Designer: No-Code ETL, Powered by the Databricks Intelligence Platform  
Databricks introduces Lakeflow Designer, an AI-powered no-code pipeline builder that enables business analysts to create production-ready ETL pipelines without coding. The tool generates standard Lakeflow Declarative Pipelines that data engineers can review and modify, eliminating the typical separation between business and technical teams. Designer leverages AI grounded in organizational data context and provides built-in governance, observability, and scalability within the unified Databricks platform.

+5  
![Post Cover image](https://media.daily.dev/image/upload/t_mobile_feed/v1/posts/75202f55e2d4f8820fdf349025d090ae?_a=AQAEulh)  
13  
1
7. 7  
[](/posts/introducing-databricks-one-dsp1krj2g "Introducing Databricks One")  
[![databricks's profile](https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/fa7aa720f2db4d1eba826814730482c8)](/sources/[source]/best-of/[year])  
5m read time • Jun 12, 2025  
### Introducing Databricks One  
Databricks announces Databricks One, a simplified business intelligence experience designed for non-technical business users. The platform provides secure access to AI-powered dashboards, Genie spaces for conversational data queries, and Databricks Apps through an intuitive interface. Built on Unity Catalog for governance, it enables business teams to access data insights without technical expertise. The full experience enters beta this summer, while consumer access entitlements are available now at no additional cost.

+5  
![Post Cover image](https://media.daily.dev/image/upload/t_mobile_feed/v1/posts/3bd77183c8a7a44d7082ee6420e1818e?_a=AQAEulh)  
12

[See all databricks archives](/sources/databricks/best-of)

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]}
{"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/sources/databricks/best-of/2025#page","url":"https://daily.dev/sources/databricks/best-of/2025","name":"Best databricks Posts of 2025","description":"The most upvoted databricks posts of 2025, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/sources/databricks/best-of/2025#items","numberOfItems":7,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/building-custom-llm-judges-for-ai-agent-accuracy-phlvzjknk","name":"Building Custom LLM Judges for AI Agent Accuracy"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/the-new-way-to-build-pipelines-on-databricks-introducing-the-ide-for-data-engineering-qovhr2fcm","name":"The New Way to Build Pipelines on Databricks: Introducing the IDE for Data Engineering"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/introducing-apache-spark-4-0-psljz0xce","name":"Introducing Apache Spark 4.0"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/architecting-a-high-concurrency-low-latency-data-warehouse-on-databricks-that-scales-kmkz9e2pb","name":"Architecting a High-Concurrency, Low-Latency Data Warehouse on Databricks That Scales"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/build-high-quality-domain-specific-agents-at-95-lower-cost-d33ay3rq1","name":"Build High-Quality, Domain-Specific Agents at 95% Lower Cost"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/announcing-lakeflow-designer-no-code-etl-powered-by-the-databricks-intelligence-platform-udxwiw3ea","name":"Announcing Lakeflow Designer: No-Code ETL, Powered by the Databricks Intelligence Platform"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/introducing-databricks-one-dsp1krj2g","name":"Introducing Databricks One"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Sources","item":"https://daily.dev/sources"},{"@type":"ListItem","position":3,"name":"databricks","item":"https://daily.dev/sources/databricks"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/sources/databricks/best-of"},{"@type":"ListItem","position":5,"name":"2025"}]}]}
```

