databricks
Read post

Backstage with Lakebase, part 3

The third installment of a series on running Backstage on Databricks Lakebase demonstrates a FinOps use case: joining live operational Postgres data from Backstage with Databricks billing data in a single SQL query, with zero ETL pipelines. Lakebase isolates compute per workload, allowing analytical queries without impacting the live portal (catalog queries at 55–65 ms, searches at 2–4 ms). Lakehouse Federation connects the Postgres catalog to Unity Catalog, though a workaround is needed since Federation only supports static credentials rather than OAuth JWTs — requiring a separate Postgres role with SCRAM-SHA-256 auth. The result is per-branch, per-developer cost visibility in billing data, including ephemeral CI branches. Lakebase's scale-to-zero behavior means idle branches incur no cost. The post also warns about orphaned branch accumulation and recommends TTL-based lifecycle controls.

    #postgresql#databricks#finops
Jul 31•7m read time•From databricks.com
Post cover image
Table of contents
Separated compute makes sharing viableThe workaround: Lakehouse federation authThe FinOps join ExpandWhy not just use ETL?Operationalizing convergenceThe federation auth gapBranch cost visibility for dev teamsWhat comes next
4.5K Impressions
databricks's image
databricks

461 Followers

•

1.4K Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard