Technology1 min read

Dispelling LTAP myths

By · Published by Everything Blog

In short

The Lakebase model unifies operational Postgres and analytical queries on one shared dataset stored directly in a data lake. Intermediate elements like caches, logs, and pageservers function strictly as performance tiers rather than distinct database copies. To handle varied processing demands efficiently, the system maintains two lossless encodings of identical rows, relying on heap pages for lookups and Parquet files for scans. These underlying columnar lake files are kept ordered by page number to streamline both compaction and page reconstruction.

Key points

  • Point lookups utilize heap pages across local compute and pageserver tiers to sustain ope…: Point lookups utilize heap pages across local compute and pageserver tiers to sustain operational performance.
  • Columnar files preserved in the lake remain organized by page number to support efficient…: Columnar files preserved in the lake remain organized by page number to support efficient page reconstruction and data compaction.
  • Maintaining a single authoritative data copy prevents the operational challenges associat…: Maintaining a single authoritative data copy prevents the operational challenges associated with synchronizing independent storage catalogs.

Sources checked by our analysis pipeline: 1

The lake is the database's storage, not a replica of it. That is why Postgres stays fast, analytics stays fresh, and no CDC pipeline is needed

Reynold Xin's post "From monolith to Lakebase to LTAP" explained what LTAP is and how the Lakebase architecture makes it possible: one governed copy of operational data, serving both Postgres and analytics, with no CDC pipeline and no second database.

Much of the commentary that followed read that claim through systems people already know. Four readings came up often:

Each of these myths rests on a wrong assumption about how Lakebase stores data. Let's take them one at a time.

The reality: LTAP keeps one durable copy of each table, in the lake. The layers in front of it hold some of the same bytes to make that table durable and fast, but none of them is a second database.

From the outside, LTAP can look like a familiar pipeline. Postgres writes rows, a process tails the log, the changes land in an Iceberg table, and analytics reads Iceberg. That pipeline is CDC. It…

Technology