The bi-directional collaboration allows Google Cloud's runtime catalog tables to be mounted into Databricks Unity Catalog and queried via serverless data warehouses or the no-code Genie tool. Simultaneously, analytics engines like BigQuery can access Unity Catalog assets without generating redundant copies. To maintain unified governance, the companies introduced an open-source Iceberg catalog labels proposal that syncs key-value metadata. This shared metadata system persists domain tags, certification statuses, and sensitive data flags across federated platforms.
Key points
Organizations can implement zero-copy data architectures across Databricks and Google Clo…: Organizations can implement zero-copy data architectures across Databricks and Google Cloud using open standards like Delta Lake and Iceberg.
The open-source catalog labels proposal preserves governance metadata including domain ta…: The open-source catalog labels proposal preserves governance metadata including domain tags and sensitive personal information flags across platforms.
Learn how Databricks and Google are advancing interoperability through open standards.
by Parth Desai, Alex Jiang and John Spencer
The Lakehouse architecture is becoming more open than ever. What started with open table formats – Delta Lake and Iceberg – has evolved into catalog federation for zero-copy access across multiple platforms. Through our partnership and Open Source contributions, Databricks and Google Cloud continue to drive advancements in the Open Lakehouse community.
Today, we're proud to announce a significant milestone in catalog interoperability in collaboration with Google: customers can now access a single copy of data from both Unity Catalog and Google Cloud's borderless Lakehouse. The Databricks and Google Cloud partnership continues to thrive, and we're committed to making bi-directional interoperability seamless.
Bringing data from Google Cloud into Databricks is simple. With Lakehouse Federation to Google Cloud, customers can mount Iceberg tables managed by Google Cloud's Lakehouse runtime catalog in Unity Catalog for analysis in Databricks.
These Iceberg tables from Google's Lakehouse runtime catalog can then be queried by Databricks Lakehouse, our serverless data warehouse, or analyzed via Genie, which intelligently…
Public sector organizations can now access advanced data and artificial intelligence tools within a dedicated, compliance-focused cloud environment. Built identically to its commercial counterpart, the offering allows government teams to prepare their architectures using existing Microsoft commitments before handling mission-critical defense workloads. This step lays the groundwork for agencies to eventually run sensitive operations under upcoming federal security authorizations.
Organizations can now perform identity resolution directly within their owned lakehouse environments governed by Unity Catalog. This integration replaces the legacy practice of exporting personally identifiable information to external third parties for matching. By conducting operations locally, companies safeguard sensitive customer records while accelerating data preparation for enterprise analytics.
Tailscale devices typically depend on reaching a central coordination server upon reboot to fetch critical network details and establish secure connections. By preserving this network map directly to local storage, machines can immediately connect to existing peer nodes even through complete coordination server outages or poor internet links. This client-side change significantly hardens connection reliability for users operating across unstable environments.