Skip to main content
Jay Palaniappan

Jay Palaniappan

Jay Palaniappan's posts

Screenshot of Python code snippet for automatic schema evolution

Data Engineering

December 1, 2025/11 min read

From Events to Insights: Complex State Processing with Schema Evolution in transformWithState

Continuous Environmental Monitoring Using the New transformWithState API

Solutions

July 30, 2025/9 min read

Continuous Environmental Monitoring Using the New transformWithState API

Introducing transformWithState in Apache Spark™ Structured Streaming

Announcements

February 24, 2025/6 min read

Introducing transformWithState in Apache Spark™ Structured Streaming

Scalable Spark Structured Streaming for REST API Destinations

Data Streaming

March 1, 2023/11 min read

Scalable Spark Structured Streaming for REST API Destinations