Session

Open Streaming Meets Governed Lakehouse: Running Apache Flink With Unity Catalog–Managed Delta Tables

Overview

ExperienceIn Person
TrackData Engineering & Streaming
IndustryCommunications, Media & Entertainment, Financial Services, Transportation
TechnologiesUnity Catalog
Skill LevelBeginner

As organizations adopt open streaming engines like Apache Flink alongside centralized governance platforms, interoperability becomes critical. This talk explores how the Flink Delta Connector bridges Flink’s real-time processing model with Delta Lake tables managed by Unity Catalog. We’ll explain how the connector preserves Delta’s ACID guarantees, integrates with UC-managed metadata, and respects centralized governance when writes originate from external Flink clusters. Through architectural deep dives and practical examples, we show how teams can build end-to-end streaming pipelines that combine Flink’s scalability with Databricks’ unified governance and lakehouse architecture.

Session Speakers

Speaker placeholderIMAGE COMING SOON

Hao Jiang

/Databricks, Inc.