The 2022 SIGMOD Systems Award recognized Spark as an innovative, widely used, open source, unified data processing system encompassing relational, streaming and machine learning workloads.
And the innovation continues. Recently we introduced Spark Connect and Project Lightspeed.
Spark Connect decouples the client and server for better stability and allows for Spark applications everywhere.
Project Lightspeed, the next generation of Spark Structured Streaming, further delivers on predictable low latency and enhanced functionality for processing events.