---
title: "Leveraging Data Assets features in Airflow 3.0 to optimise resource utilization by more than 30%"
url: https://daily.dev/posts/leveraging-data-assets-features-in-airflow-3-0-to-optimise-resource-utilization-by-more-than-30--daarqlw33
source_url: https://blogs.halodoc.io/leveraging-data-assets-features-in-airflow-3-0-to-optimise-resource-utilization-by-more-than-30
type: article
source: "Halodoc"
published: 2026-07-31T04:52:37.330Z
updated: 2026-08-02T02:17:57.452Z
tags: ["aws", "data-engineering", "apache-airflow", "workflow-orchestration"]
reading_time: 15
upvotes: 1
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Leveraging Data Assets features in Airflow 3.0 to optimise resource utilization by more than 30%

**[Halodoc](https://daily.dev/sources/halodoc)** · 15 min read · 1 upvotes · 0 comments

## Summary

Halodoc's data engineering team shares how they migrated from Airflow 2.10 to 3.2.1 on Amazon MWAA to reduce resource waste during ETL burst windows. Two key changes drove the gains: replacing polling sensors with Airflow 3.0 Data Assets (event-driven scheduling that eliminates worker slots held just to wait), and swapping a synchronous psycopg-based Redshift operator for the deferrable RedshiftDataOperator backed by the Redshift Data API. The migration covered 30 DAGs for Data Assets and 130 for the deferrable operator. Results after a month of monitoring: base worker CPU dropped from 26.1% to 7.71%, memory from 49.2% to 30.8%, scheduler CPU from 36.1% to 29.4%, and table-locking errors fell ~38%. The post also details a critical N+1 query bug in Airflow 3.0.6 that pinned the metadata DB at 100% CPU, requiring an upgrade to 3.2.1, plus a DAG versioning pitfall caused by runtime-variable values in DAG constructors.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://blogs.halodoc.io/leveraging-data-assets-features-in-airflow-3-0-to-optimise-resource-utilization-by-more-than-30>

## Similar posts on daily.dev

- [Apache Airflow 3.2.0: Data-Aware Workflows at Scale](https://daily.dev/posts/apache-airflow-3-2-0-data-aware-workflows-at-scale-ilba3biwx) · Apache Airflow · 16 upvotes · 1 comments
- [Migrating from Apache Airflow v2 to v3](https://daily.dev/posts/migrating-from-apache-airflow-v2-to-v3-x05q5e2fa) · InfoWorld · 0 upvotes · 0 comments
- [Amazon MWAA now supports Apache Airflow 3.2](https://daily.dev/posts/amazon-mwaa-now-supports-apache-airflow-3-2-1bn64j0je) · AWS · 0 upvotes · 0 comments

---

Tags: [#aws](https://daily.dev/tags/aws), [#data-engineering](https://daily.dev/tags/data-engineering), [#apache-airflow](https://daily.dev/tags/apache-airflow), [#workflow-orchestration](https://daily.dev/tags/workflow-orchestration)

[View this post on daily.dev](https://daily.dev/posts/leveraging-data-assets-features-in-airflow-3-0-to-optimise-resource-utilization-by-more-than-30--daarqlw33)