Skip to main content
Jerry Peng

Jerry Peng

Jerry Peng's posts

Concurrent-Stages-in-Real-Time-Mode-Decreases-Latency

Data Engineering

March 16, 2026/5 min read

Breaking the Microbatch Barrier: The Architecture of Apache Spark Real-Time Mode

Real-Time Streaming on Spark RTM vs. Flink

Product

March 2, 2026/6 min read

Real-Time Mode: Ultra-low latency streaming on Spark APIs without a second engine

Apache Spark 4.1 logo with star on dark background

Announcements

December 22, 2025/10 min read

Introducing Apache Spark® 4.1

Introducing Real-Time Mode in Apache Spark™ Structured Streaming

Announcements

August 19, 2025/5 min read

Introducing Real-Time Mode in Apache Spark™ Structured Streaming

Latency goes subsecond in Apache Spark Structured Streaming

Data Streaming

May 15, 2023/12 min read

Latency goes subsecond in Apache Spark Structured Streaming

db-199-project-lightspeed

Data Science and ML

June 28, 2022/8 min read

Project Lightspeed: Faster and Simpler Stream Processing With Apache Spark