Skip to main content

Advanced Machine Learning with Databricks

This course is aimed at data scientists and machine learning practitioners and consists of two, four-hours modules. 


Machine Learning at Scale

In this course, you will gain theoretical and practical knowledge of Apache Spark’s architecture and its application to machine learning workloads within Databricks. You will learn when to use Spark for data preparation, model training, and deployment, while also gaining hands-on experience with Spark ML and pandas APIs on Spark. This course will introduce you to advanced concepts like hyperparameter tuning and scaling Optuna with Spark. This course will use features and concepts introduced in the associate course such as MLflow and Unity Catalog for comprehensive model packaging and governance.


Advanced Machine Learning Operations

In this course, you will be provided with a comprehensive understanding of the machine learning lifecycle and MLOps, emphasizing best practices for data and model management, testing, and scalable architectures. It covers key MLOps components, including CI/CD, pipeline management, and environment separation, while showcasing Databricks’ tools for automation and infrastructure management, such as Databricks Asset Bundles (DABs), Workflows, and Mosaic AI Model Serving. You will learn about monitoring, custom metrics, drift detection, model rollout strategies, A/B testing, and the principles of reliable MLOps systems, providing a holistic view of implementing and managing ML projects in Databricks.

Skill Level
Professional
Duration
8h
Prerequisites

The content was developed for participants with these skills/knowledge/abilities: 

  • Basic understanding of DS/ML concepts (e.g. classification and regression models), common model metrics (e.g. F1-score), and Python libraries (e.g. scikit-learn and XGBoost).

  • The user should have intermediate-level knowledge of traditional machine learning concepts, development, and the use of Python and Git for ML projects.

  • It is recommended that the user has intermediate-level experience with Python. 

Outline

Machine Learning at Scale

Machine Learning Development with Spark

A Brief Overview of Spark Architecture for Machine Learning
Introduction to Spark ML for Model Development
Model Tracking and Packaging with MLflow and Unity Catalog on Databricks
Model Development with Spark

Model Tuning with Optuna on Spark

Overview of Hyperparameter Tuning
Introduction to Optuna on Spark
Model Tuning with Optuna


Advanced Machine Learning Operations

Overview of Machine Learning Operations on Databricks
Review of MLOps
Streamlining Development to Deployment
Continuous Workflows for Machine Learning Operations
Streamlining MLOps
Streamlining MLOps with Databricks
Testing Strategies with Databricks
Automate Comprehensive Testing
Model Rollout Strategies with Databricks
Model Quality and Lakehouse Monitoring
Introduction to Monitoring
Lakehouse Monitoring
Streamlining Multiple Environment Deployments - DABsBuild ML assets as CodeCourse Summary and Next Steps

Upcoming Public Classes

Date
Time
Your Local Time
Language
Price
May 27
09 AM - 05 PM (Europe/Paris)
-
English
$1000.00
Jun 16
09 AM - 05 PM (Europe/Paris)
-
English
$1000.00
Jun 23
08 AM - 04 PM (Asia/Kolkata)
-
English
$1000.00
Jul 22
09 AM - 05 PM (America/New_York)
-
English
$1000.00
Jul 28
09 AM - 05 PM (Europe/Paris)
-
English
$1000.00

Public Class Registration

If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.

Private Class Request

If your company is interested in private training, please submit a request.

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Apache Spark Developer

Apache Spark™ Programming with Databricks

This course serves as an appropriate entry point to learn Apache Spark Programming with Databricks. 

Below, we describe each of the four, four-hour modules included in this course.

Introduction to Apache Spark

This course offers essential knowledge of Apache Spark, with a focus on its distributed architecture and practical applications for large-scale data processing. Participants will explore programming frameworks, learn the Spark DataFrame API, and develop skills for reading, writing, and transforming data using Python-based Spark workflows. 

Developing Applications with Apache Spark

Master scalable data processing with Apache Spark in this hands-on course. Learn to build efficient ETL pipelines, perform advanced analytics, and optimize distributed data transformations using Spark’s DataFrame API. Explore grouping, aggregation, joins, set operations, and window functions. Work with complex data types like arrays, maps, and structs while applying best practices for performance optimization.

Stream Processing and Analysis with Apache Spark

Learn the essentials of stream processing and analysis with Apache Spark in this course. Gain a solid understanding of stream processing fundamentals and develop applications using the Spark Structured Streaming API. Explore advanced techniques such as stream aggregation and window analysis to process real-time data efficiently. This course equips you with the skills to create scalable and fault-tolerant streaming applications for dynamic data environments.

Monitoring and Optimizing Apache Spark Workloads on Databricks

This course explores the Lakehouse architecture and Medallion design for scalable data workflows, focusing on Unity Catalog for secure data governance, access control, and lineage tracking. The curriculum includes building reliable, ACID-compliant pipelines with Delta Lake. You'll examine Spark optimization techniques, such as partitioning, caching, and query tuning, and learn performance monitoring, troubleshooting, and best practices for efficient data engineering and analytics to address real-world challenges.

Languages Available: English | 日本語 | 한국어

Paid
16h
Lab
instructor-led
Associate

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.