Skip to main content

Monitoring and Optimizing Apache Spark Workloads on Databricks

This course explores the Lakehouse architecture and Medallion design for scalable data workflows, focusing on Unity Catalog for secure data governance, access control, and lineage tracking. The curriculum includes building reliable, ACID-compliant pipelines with Delta Lake. You'll examine Spark optimization techniques, such as partitioning, caching, and query tuning, and learn performance monitoring, troubleshooting, and best practices for efficient data engineering and analytics to address real-world challenges.

Skill Level
Associate
Duration
4h
Prerequisites

- Basic programming knowledge

- Familiarity with Python

- Basic understanding of SQL queries (SELECT, JOIN, GROUP BY)

- Familiarity with data processing concepts

- No prior Spark or Databricks experience required

Outline

Monitoring and Optimizing Apache Spark Workloads on Databricks

  • Apache Spark and Databricks
  • Using Apache Spark with Delta Lake
  • Demo: Introduction to Delta Lake
  • Lab: Introduction to Delta Lake
  • Optimizing Apache Spark
  • Demo: Optimizing Apache Spark
  • Lab: Optimizing Apache Spark

Upcoming Public Classes

Date
Time
Language
Price
Jun 25
09 AM - 01 PM (Europe/London)
English
$750.00
Jun 30
09 AM - 01 PM (Asia/Kolkata)
English
$750.00
Jun 30
01 PM - 05 PM (America/New_York)
English
$750.00
Jul 23
01 PM - 05 PM (Europe/Paris)
English
$750.00
Jul 28
01 PM - 05 PM (America/New_York)
English
$750.00
Aug 19
09 AM - 01 PM (Asia/Kolkata)
English
$750.00
Aug 20
09 AM - 01 PM (Europe/Paris)
English
$750.00
Aug 25
09 AM - 01 PM (America/New_York)
English
$750.00
Sep 01
01 PM - 05 PM (Europe/London)
English
$750.00
Sep 03
01 PM - 05 PM (Asia/Kolkata)
English
$750.00
Sep 05
01 PM - 05 PM (America/New_York)
English
$750.00
Oct 07
09 AM - 01 PM (Europe/London)
English
$750.00
Oct 07
01 PM - 05 PM (America/New_York)
English
$750.00
Oct 09
01 PM - 05 PM (Asia/Singapore)
English
$750.00

Public Class Registration

If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.

Private Class Request

If your company is interested in private training, please submit a request.

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.