Monitoring and Optimizing Apache Spark Workloads on Databricks
This course explores the Lakehouse architecture and Medallion design for scalable data workflows, focusing on Unity Catalog for secure data governance, access control, and lineage tracking. The curriculum includes building reliable, ACID-compliant pipelines with Delta Lake. You'll examine Spark optimization techniques, such as partitioning, caching, and query tuning, and learn performance monitoring, troubleshooting, and best practices for efficient data engineering and analytics to address real-world challenges.
- Basic programming knowledge
- Familiarity with Python
- Basic understanding of SQL queries (SELECT, JOIN, GROUP BY)
- Familiarity with data processing concepts
- No prior Spark or Databricks experience required
Outline
Monitoring and Optimizing Apache Spark Workloads on Databricks
- Apache Spark and Databricks
- Using Apache Spark with Delta Lake
- Demo: Introduction to Delta Lake
- Lab: Introduction to Delta Lake
- Optimizing Apache Spark
- Demo: Optimizing Apache Spark
- Lab: Optimizing Apache Spark
Upcoming Public Classes
Date | Time | Language | Price |
|---|---|---|---|
Jul 23 | 01 PM - 05 PM (Europe/Paris) | English | $750.00 |
Jul 28 | 01 PM - 05 PM (America/New_York) | English | $750.00 |
Aug 19 | 09 AM - 01 PM (Asia/Kolkata) | English | $750.00 |
Aug 20 | 09 AM - 01 PM (Europe/Paris) | English | $750.00 |
Aug 25 | 09 AM - 01 PM (America/New_York) | English | $750.00 |
Sep 01 | 01 PM - 05 PM (Europe/London) | English | $750.00 |
Sep 03 | 01 PM - 05 PM (Asia/Kolkata) | English | $750.00 |
Sep 05 | 01 PM - 05 PM (America/New_York) | English | $750.00 |
Oct 07 | 09 AM - 01 PM (Europe/London) | English | $750.00 |
Oct 07 | 01 PM - 05 PM (America/New_York) | English | $750.00 |
Oct 09 | 01 PM - 05 PM (Asia/Singapore) | English | $750.00 |
Public Class Registration
If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.
Private Class Request
If your company is interested in private training, please submit a request.
Registration options
Databricks has a delivery method for wherever you are on your learning journey
Self-Paced
Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos
Register now
Instructor-Led
Public and private courses taught by expert instructors across half-day to two-day courses
Register now
Blended Learning
Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase
Purchase now
Skills@Scale
Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details
