Air Traffic Control with Apache Spark Structured Streaming Real-Time Mode

Anant demonstrates a real-time air traffic control system using Apache Spark Real-Time Mode (RTM), achieving sub-300ms end-to-end latency for live flight telemetry. The architecture combines Structured Streaming for stateful processing, Lakebase for low-latency serving, and Databricks Apps for React visualization. He walks through the Spark code, including Transform with State for congestion detection and the RTM trigger config.