Skip to main content
Page 1
Engineering blog

A Deep Dive into the Latest Performance Improvements of Stateful Pipelines in Apache Spark Structured Streaming

February 28, 2024 by Mojgan Mazouchi, Mrityunjay Kumar, Anish Shrigondekar and Karthikeyan Ramasamy in Engineering Blog
This post is the second part of our two-part series on the latest performance improvements of stateful pipelines. The first part of this...
Engineering blog

Performance Improvements for Stateful Pipelines in Apache Spark Structured Streaming

February 28, 2024 by Mojgan Mazouchi, Mrityunjay Kumar, Anish Shrigondekar and Karthikeyan Ramasamy in Engineering Blog
Introduction Apache Spark™ Structured Streaming is a popular open-source stream processing platform that provides scalability and fault tolerance, built on top of the...
Company blog

Real-Time Insights: The Top Three Reasons Why Customers Love Data Streaming with Databricks

March 14, 2023 by Erika Ehrli, Karthikeyan Ramasamy, Ray Zhu, Richard Tomlinson, Matt Jones and Frank Munz in Company Blog
The world operates in real-time The ability to make real-time decisions in today's fast paced world is more critical than ever before. Today's...