Skip to main content
Page 1
Engineering blog

Introducing Low-latency Continuous Processing Mode in Structured Streaming in Apache Spark 2.3

March 20, 2018 by Joseph Torres, Michael Armbrust, Tathagata Das and Shixiong Zhu in Data Engineering
Import this notebook on Databricks Structured Streaming in Apache Spark 2.0 decoupled micro-batch processing from its high-level APIs for a couple of reasons...
Engineering blog

Introducing Stream-Stream Joins in Apache Spark 2.3

March 13, 2018 by Tathagata Das and Joseph Torres in Engineering Blog
Since we introduced Structured Streaming in Apache Spark 2.0 , it has supported joins (inner join and some type of outer joins) between...