Technology1 min read

Talk to your clinical data: unlocking AWS HealthLake with OpenSharing and Genie One

By · Published by Everything Blog

In short

Previously, querying clinical data managed in AWS HealthLake required building dedicated export pipelines and handling governance across multiple separated environments. Under the new architecture, a custom OpenSharing server runs as a managed Databricks App to resolve Apache Iceberg snapshots and retrieve temporary credentials from AWS Lake Formation. Databricks compute then reads the pre-signed files directly from Amazon S3 using OIDC federation. This setup mounts clinical assets inside Databricks Unity Catalog for centralized governance and links them to Genie One for natural language analytics.

Key points

  • Direct queries eliminate the need to construct export pipelines or duplicate clinical dat…: Direct queries eliminate the need to construct export pipelines or duplicate clinical data across separate systems.
  • Centralized governance within Databricks Unity Catalog allows organizations to audit usag…: Centralized governance within Databricks Unity Catalog allows organizations to audit usage and enforce fine-grained access rules.
  • Integrating the data with Genie One lets users interrogate clinical records using natural…: Integrating the data with Genie One lets users interrogate clinical records using natural language queries instead of complex workflows.

Sources checked by our analysis pipeline: 1

Set up a custom OpenSharing integration to extend AWS HealthLake-managed FHIR data to Databricks, enabling Unity Catalog governance and conversational analytics with Genie One.

Many healthcare and life sciences organizations have standardized on AWS HealthLake to manage clinical data, but extending that data to other platforms for analytics and AI has traditionally required more effort. For companies seeking to use data living in HealthLake with external analytics tooling, this process has required building export pipelines, duplicating data, and managing governance separately in each location. This has limited the interoperability of HealthLake-managed FHIR data across other tools and platforms.

In this blog, we present a new solution leveraging OpenSharing (A Linux Foundation AI & Data Project) to enable a first-of-its-kind integration between HealthLake and Databricks. This architecture allows users to query HealthLake data live from Databricks, bringing Databricks governance, analytics, and AI capabilities to clinical datasets. By integrating with HealthLake, Databricks can enable organizations to unlock deeper insights from FHIR data and open the door to a broader set of analytics and AI use cases. Furthermore, that same clinical data can…

Technology