Session
Open Streaming Meets Governed Lakehouse: Running Apache Flink With Unity Catalog–Managed Delta Tables
Overview
| Experience | In Person |
|---|---|
| Track | Data Engineering & Streaming |
| Industry | Communications, Media & Entertainment, Financial Services, Transportation |
| Technologies | Unity Catalog |
| Skill Level | Beginner |
As organizations adopt open streaming engines like Apache Flink alongside centralized governance platforms, interoperability becomes critical. This talk explores how the Flink Delta Connector bridges Flink’s real-time processing model with Delta Lake tables managed by Unity Catalog. We’ll explain how the connector preserves Delta’s ACID guarantees, integrates with UC-managed metadata, and respects centralized governance when writes originate from external Flink clusters. Through architectural deep dives and practical examples, we show how teams can build end-to-end streaming pipelines that combine Flink’s scalability with Databricks’ unified governance and lakehouse architecture.
Session Speakers
Hao Jiang
/Databricks, Inc.