Developing Applications with Apache Spark
Master scalable data processing with Apache Spark in this course. Learn to build efficient ETL pipelines, perform advanced analytics, and optimize distributed data transformations using Spark’s DataFrame API. Explore grouping, aggregation, joins, set operations, and window functions. Work with complex data types like arrays, maps, and structs while applying best practices for performance optimization.
The content was developed for participants with these skills/knowledge/abilities:
• Basic programming knowledge
• Familiarity with Python
• Basic understanding of SQL queries (SELECT, JOIN, GROUP BY)
• Familiarity with data processing concepts
• "Introduction to Apache Spark Course" or Previous Databricks experience required
Outline
1. DataFrame API Basics
• DataFrame API Basics
• Demo: Basic ETL with the DataFrame API
2. Grouping and Aggregating Data
• Grouping and Aggregating Data
• Demo: Grouping and Aggregating Data
• Lab: Grouping and Aggregating E-Commerce Data
3. DataFrame Relational Operations
• DataFrame Relational Operations
• Demo: DataFrame Relational Operations in Spark
4. Working with Complex Data
• Working with Complex Data
• Demo: Working with Complex Data Types in Spark
• Lab: Working with Complex Data Types in E-Commerce Data
Upcoming Public Classes
Date | Time | Your Local Time | Language | Price |
|---|---|---|---|---|
Nov 25 | 01 PM - 05 PM (Australia/Sydney) | - | English | $750.00 |
Nov 25 | 09 AM - 01 PM (Europe/Paris) | - | English | $750.00 |
Nov 25 | 09 AM - 01 PM (America/Los_Angeles) | - | English | $750.00 |
Dec 16 | 09 AM - 01 PM (Asia/Kolkata) | - | English | $750.00 |
Dec 16 | 01 PM - 05 PM (Europe/Paris) | - | English | $750.00 |
Dec 16 | 09 AM - 01 PM (America/New_York) | - | English | $750.00 |
Jan 27 | 09 AM - 01 PM (Asia/Singapore) | - | English | $750.00 |
Jan 27 | 09 AM - 01 PM (Europe/Paris) | - | English | $750.00 |
Jan 27 | 01 PM - 05 PM (America/New_York) | - | English | $750.00 |
Public Class Registration
If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.
Private Class Request
If your company is interested in private training, please submit a request.
Registration options
Databricks has a delivery method for wherever you are on your learning journey
Self-Paced
Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos
Register nowInstructor-Led
Public and private courses taught by expert instructors across half-day to two-day courses
Register nowBlended Learning
Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase
Purchase nowSkills@Scale
Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

