Querying State Data in Spark Structured Streaming With the State Reader API

The State Reader API allows users to access and analyze Structured Streaming’s internal state data. Its primary purpose is to facilitate the development, debugging and troubleshooting of stateful Structured Streaming workloads.

The State Reader API introduces much-needed transparency, accessibility and ease of use to stateful streaming processes. It is straightforward and user-friendly, simplifying complex investigative tasks.