Native Streaming-to-Lakehouse Governance with Unity Catalog
Overview
| Experience | In Person |
|---|---|
| Track | Governance & Security |
| Industry | Enterprise Technology, Communications, Media & Entertainment, Financial Services |
| Technologies | Unity Catalog |
| Skill Level | Intermediate |
Real-time data powers modern AI and analytics yet governing high-velocity streaming data in the lakehouse remains a challenge. In this session, StreamNative and Databricks showcase a native integration that brings governance to streaming pipelines through Databricks Unity Catalog without sacrificing performance or simplicity.
We introduce catalog-based commits, a new approach where streaming data written in Delta Lake and Apache Iceberg formats is registered and governed in Unity Catalog at commit time. This eliminates post-processing, manual metadata synchronization and governance gaps, while enabling consistent access control, lineage and auditing across streaming and batch workloads.
Attendees will learn how this integration reduces operational complexity, accelerates AI and real-time analytics and delivers a seamless path from event streams to governed, AI-ready lakehouse tables.
Session Speakers
KUNDAN VYAS
/Director,Product & Partnerships
StreamNative
Benjamin Mathew
/Product Manager
Databricks