OpenDataLakehouse
Menu

Vendor-neutral reference

The open
lakehouse

A data architecture that stores data in open file and table formatson commodity object storage, so that any compliant engine can read and write it without vendor lock-in.

Start with the definitionSee the architecture
Reference entries
201
Architecture layers
9
Comparisons
3
SparkTrinoFlinkDuckDBSAP/DremioCatalogTable formatData fileData fileData fileData fileObject storage you control

The stack, one layer at a time

An open lakehouse is assembled from layers, each with one job and several implementations. Any one of them can be replaced without disturbing the others, which is the entire point of the architecture.

  1. Agents & AI18 entriesHow do agents use any of this safely?Agentic analyticsRAGText-to-SQLVector search
  2. Semantics12 entriesWhat does this data mean?Semantic layerMetricsOntologyModeling
  3. Movement15 entriesHow does data get in, and stay current?AirflowdbtDagsterCDCStreaming
  4. Interchange3 entriesHow does data move between systems?Apache ArrowArrow FlightFlight SQL
  5. Compute43 entriesWhat actually runs the query?SparkTrinoFlinkDuckDBDremio
  6. Catalog17 entriesHow do engines find and govern those tables?Apache PolarisIceberg RESTNessieGlueUnity
  7. Table format50 entriesWhat makes those files behave like a table?Apache IcebergDelta LakeApache HudiApache Paimon
  8. Storage format26 entriesHow is the data physically written down?Apache ParquetORCAvroObject storage
  9. Foundations17 entriesWhat kind of system are we building?LakehouseData lakeData warehouseMedallion

Start here

Four pages that cover the whole subject, in the order they make sense.

01What it isThe definition, the three claims inside the term, and what it replaced02PrinciplesFive commitments that make an architecture open, each with a test you can run03ArchitectureEvery layer, the options at each, and where the clean model blurs04HistoryWhy the architecture is shaped this way, one failure at a time

The choices, side by side

Each layer has several viable options. These comparisons lead with the table.

All comparisons
foundationLakehouse vs warehouse vs data lakeA data lake gives you cheap storage without guarantees, a warehouse gives you guarantees without engine choice, and a lakehouse adds the guarantees to the lake so you keep both.tableIceberg vs Delta Lake vs Hudi vs PaimonIceberg has the widest multi-engine support, Delta is strongest inside the Databricks ecosystem, Hudi is built around upserts and incremental reads, and Paimon targets streaming-first workloads.catalogComparing lakehouse catalogsThe catalog choice is mostly a governance decision: all of them can point engines at tables, but they differ sharply in how they handle permissions, credential vending, and whether their API is open enough to swap later.

Look something up

201 in-depth entries, each mapped to the layer it belongs to, plus a one-line glossary for when that is all you need.

Browse the library
Reference libraryFull entries, several thousand words each, grouped by layerGlossaryEvery term defined in one line, on a single pageFAQDirect answers to the questions that come up most

Implementation reading

Written by vendors, listed here because the technical content is useful. Nothing on this site is a recommendation to buy anything.

More reading, including independent sources, is collected in theblog roll, video roll, andbook roll.