Skip to main content
Karthik Ramasamy

Karthik Ramasamy

Karthik Ramasamy's posts

The Evolution of Arbitrary Stateful Stream Processing in Spark

Solutions

May 7, 2025/13 min read

The Evolution of Arbitrary Stateful Stream Processing in Spark

Introducing transformWithState in Apache Spark™ Structured Streaming

Announcements

February 24, 2025/6 min read

Introducing transformWithState in Apache Spark™ Structured Streaming

light

Engineering

June 28, 2023/17 min read

Project Lightspeed Update - Advancing Apache Spark Structured Streaming

Latency goes subsecond in Apache Spark Structured Streaming

Data Streaming

May 15, 2023/12 min read

Latency goes subsecond in Apache Spark Structured Streaming

Databricks at Current 2022

Events

September 28, 2022/2 min read

Databricks at Current 2022

db-199-project-lightspeed

Data Science and ML

June 28, 2022/8 min read

Project Lightspeed: Faster and Simpler Stream Processing With Apache Spark

PySpark

Open Source

May 27, 2022/7 min read

How to Monitor Streaming Queries in PySpark