SESSION

Optimizing MERGE Performance using Liquid Clustering

OVERVIEW

EXPERIENCEIn Person
TYPEBreakout
TRACKData Lakehouse Architecture
INDUSTRYEnterprise Technology
TECHNOLOGIESApache Spark, Delta Lake, ETL
SKILL LEVELIntermediate
DURATION40 min

This session explores optimizing MERGE performance using Liquid Clustering and Photon. It explores how you can use recent Delta Lake and Photon features such as Liquid Clustering, Deletion Vectors, and Predictive I/O for Updates to make your MERGEs run smoothly and with predictable performance.

SESSION SPEAKERS

Bart Samwel

/Principal Engineer
Databricks