Technology1 min read

Advancing Catalog Interoperability with Unity Catalog and Google Cloud’s Borderless Lakehouse

By · Published by Everything Blog

In short

The bi-directional collaboration allows Google Cloud's runtime catalog tables to be mounted into Databricks Unity Catalog and queried via serverless data warehouses or the no-code Genie tool. Simultaneously, analytics engines like BigQuery can access Unity Catalog assets without generating redundant copies. To maintain unified governance, the companies introduced an open-source Iceberg catalog labels proposal that syncs key-value metadata. This shared metadata system persists domain tags, certification statuses, and sensitive data flags across federated platforms.

Key points

  • Organizations can implement zero-copy data architectures across Databricks and Google Clo…: Organizations can implement zero-copy data architectures across Databricks and Google Cloud using open standards like Delta Lake and Iceberg.
  • The open-source catalog labels proposal preserves governance metadata including domain ta…: The open-source catalog labels proposal preserves governance metadata including domain tags and sensitive personal information flags across platforms.
  • Shared federated metadata provides critical operational context for artificial intelligen…: Shared federated metadata provides critical operational context for artificial intelligence agents querying cross-platform enterprise assets.

Sources checked by our analysis pipeline: 1

Learn how Databricks and Google are advancing interoperability through open standards.

by Parth Desai, Alex Jiang and John Spencer

The Lakehouse architecture is becoming more open than ever. What started with open table formats – Delta Lake and Iceberg – has evolved into catalog federation for zero-copy access across multiple platforms. Through our partnership and Open Source contributions, Databricks and Google Cloud continue to drive advancements in the Open Lakehouse community.

Today, we're proud to announce a significant milestone in catalog interoperability in collaboration with Google: customers can now access a single copy of data from both Unity Catalog and Google Cloud's borderless Lakehouse. The Databricks and Google Cloud partnership continues to thrive, and we're committed to making bi-directional interoperability seamless.

Bringing data from Google Cloud into Databricks is simple. With Lakehouse Federation to Google Cloud, customers can mount Iceberg tables managed by Google Cloud's Lakehouse runtime catalog in Unity Catalog for analysis in Databricks.

These Iceberg tables from Google's Lakehouse runtime catalog can then be queried by Databricks Lakehouse, our serverless data warehouse, or analyzed via Genie, which intelligently…

Technology