Technology1 min read

ClickHouse and Power BI, columnar end to end: the Arrow Flight connector is in public preview

By · Published by Everything Blog

In short

The integration relies on an open standard built on gRPC to maintain end-to-end columnar storage throughout every transfer. Because Power BI contains its own native Flight SQL driver, users do not need to install the separate open-source ADBC driver built for custom applications. Additionally, data refreshes can execute immediately within the Power BI service without requiring intermediate deployments. The traditional ODBC connector remains supported alongside this new implementation.

Key points

  • Eliminating row conversions reduces processing strain on ClickHouse while significantly a…: Eliminating row conversions reduces processing strain on ClickHouse while significantly accelerating large data imports.
  • Data refreshes can now operate straight from the Power BI service without intermediate de…: Data refreshes can now operate straight from the Power BI service without intermediate deployments.
  • The existing ODBC-based connector will remain fully supported alongside the new preview c…: The existing ODBC-based connector will remain fully supported alongside the new preview connector.

Sources checked by our analysis pipeline: 1

Connect Power BI to ClickHouse directly, over Arrow Flight SQL.

ClickHouse stores data in columns. Power BI stores data in columns. Until now, getting from one to the other meant turning that data into rows and back again.

Today we're announcing the ClickHouse Arrow Flight connector for Power BI, now in public preview. It connects Power BI directly to ClickHouse over Arrow Flight SQL, the open standard the data ecosystem has been converging on, and keeps your data columnar the whole way.

In practice, that means three things: refreshes run straight from the Power BI service with nothing to deploy in between, large loads are faster, and ClickHouse does far less work to serve them.

Why a new connector?

The existing ClickHouse connector for Power BI is built on ODBC. It has served a lot of dashboards well, and it remains fully supported. But Power BI's connectivity is moving toward Arrow-native drivers, and the new connector is built for where the platform is heading. The reason comes down to the shape of the data.

ODBC was designed in the early…

Technology