Session
Introducing Simplified State Tracking in Apache Spark™ Structured Streaming
Overview
| Experience | In Person |
|---|---|
| Type | Lightning Talk |
| Track | Data Engineering and Streaming |
| Industry | Manufacturing, Media and Entertainment, Financial Services |
| Technologies | Apache Spark |
| Skill Level | Advanced |
| Duration | 20 min |
This presentation will review the new change feed and snapshot capabilities in Apache Spark™ Structured Streaming’s State Reader API. The State Reader API enables users to access and analyze Structured Streaming's internal state data. Readers will learn how to leverage the new features to debug, troubleshoot and analyze state changes efficiently, making streaming workloads easier to manage at scale.
Session Speakers
Craig Lukasik
/Sr. SSA
Databricks