Skip to main content
Karthikeyan Ramasamy

Karthikeyan Ramasamy

Karthikeyan Ramasamy's posts

Screenshot of Python code snippet for automatic schema evolution

Data Engineering

December 1, 2025/11 min read

From Events to Insights: Complex State Processing with Schema Evolution in transformWithState

Introducing Real-Time Mode in Apache Spark™ Structured Streaming

Announcements

August 19, 2025/5 min read

Introducing Real-Time Mode in Apache Spark™ Structured Streaming

Continuous Environmental Monitoring Using the New transformWithState API

Solutions

July 30, 2025/9 min read

Continuous Environmental Monitoring Using the New transformWithState API

UA

Data Engineering

February 28, 2024/4 min read

A Deep Dive into the Latest Performance Improvements of Stateful Pipelines in Apache Spark Structured Streaming

stream

Data Engineering

February 27, 2024/5 min read

Performance Improvements for Stateful Pipelines in Apache Spark Structured Streaming

Real-Time Insights

Announcements

March 14, 2023/8 min read

Real-Time Insights: The Top Three Reasons Why Customers Love Data Streaming with Databricks