Stream Processing and Analysis with Apache Spark™
This course guides learners on how to develop scalable, fault-tolerant stream processing applications using the Spark Structured Streaming API on Databricks.
The content was developed for participants with these skills/knowledge/abilities:
• Basic programming knowledge
• Familiarity with Python
• Basic understanding of SQL queries (SELECT, JOIN, GROUP BY)
• Familiarity with data processing concepts
• Basic understanding of Apache Spark
Outline
1. Introduction to Stream Processing
• Introduction to Stream Processing
• Demo: Your First Streaming Query
2. Spark Structured Streaming
• Spark Structured Streaming
• Demo: Introduction to Spark Structured Streaming
• Lab: Building Streaming Queries
3. Stream Aggregations, Windows and Watermarks
• Stream Aggregations, Windows and Watermarks
• Demo: Window Aggregation in Spark Structured Streaming
• Lab: Window Aggregation and Late Data
4. Real-Time Mode
• Real-Time Mode in Structured Streaming
• Demo: Kafka to Real-Time Spark with Live Visualization
Upcoming Public Classes
Date | Time | Your Local Time | Language | Price |
|---|---|---|---|---|
Oct 09 | 09 AM - 01 PM (Asia/Kolkata) | - | English | $750.00 |
Oct 09 | 09 AM - 01 PM (Europe/Paris) | - | English | $750.00 |
Oct 09 | 01 PM - 05 PM (America/New_York) | - | English | $750.00 |
Nov 24 | 09 AM - 01 PM (America/Los_Angeles) | - | English | $750.00 |
Nov 26 | 01 PM - 05 PM (Australia/Sydney) | - | English | $750.00 |
Nov 26 | 09 AM - 01 PM (Europe/Paris) | - | English | $750.00 |
Dec 17 | 09 AM - 01 PM (Asia/Kolkata) | - | English | $750.00 |
Dec 17 | 01 PM - 05 PM (Europe/Paris) | - | English | $750.00 |
Dec 17 | 09 AM - 01 PM (America/New_York) | - | English | $750.00 |
Jan 28 | 09 AM - 01 PM (Asia/Singapore) | - | English | $750.00 |
Jan 28 | 09 AM - 01 PM (Europe/Paris) | - | English | $750.00 |
Jan 28 | 01 PM - 05 PM (America/New_York) | - | English | $750.00 |
Public Class Registration
If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.
Private Class Request
If your company is interested in private training, please submit a request.
Registration options
Databricks has a delivery method for wherever you are on your learning journey
Self-Paced
Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos
Register nowInstructor-Led
Public and private courses taught by expert instructors across half-day to two-day courses
Register nowBlended Learning
Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase
Purchase nowSkills@Scale
Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

