Skip to main content

Get Started with Databricks for Data Engineering

This course introduces the foundational skills needed to perform a basic data engineering workflow on the Databricks Data Intelligence Platform. You will explore the workspace, work with Unity Catalog, and learn the day-to-day building blocks a data engineer uses on Databricks.


The course follows a hands-on path. You start by getting oriented in the workspace, then work through paired Demo and Lab notebooks for each topic. Demos walk you through a concept with the instructor or a guided notebook; Labs ask you to apply what you just saw on your own.


The content covers:

• The Databricks Data Intelligence Platform and how the Databricks workspace, Unity Catalog, and notebooks fit together.

• Creating and managing Delta Lake tables.

• Modifying data with INSERT, UPDATE, and DELETE.

• Exploring version history and time travel on Delta tables.

• Ingesting data with Lakeflow Connect options: CTAS, the Upload UI, and COPY INTO.

• Building a Medallion Architecture pipeline that transforms data through Bronze, Silver, and Gold layers.

• Automating pipelines with Lakeflow Jobs.

• (Bonus) Building a declarative pipeline with Spark Declarative Pipelines.


You can create a Databricks Free Edition account and try the follow-along demos in a hands-on environment.


Languages Available: English | 日本語 | Português BR | 한국어 | Español française

Skill Level
Onboarding
Duration
2h
Prerequisites

• Basic familiarity with cloud data platforms. You understand what a database, table, and query are at a conceptual level.

• Working knowledge of SQL. You can read and write SELECT statements with WHERE, GROUP BY, and aggregates, and you understand INSERT, UPDATE, and DELETE.

• General awareness of data engineering concepts like data ingestion, transformation, and pipelines is helpful but not required — the course covers the basics.

Outline

Get Started with Data Engineering on Databricks

• Databricks Data Intelligence Platform

• Demo: Databricks Workspace Walkthrough

• Demo: Find Your Data and Create a table

• Lab: Find and Create Tables

• Demo: Modify Data with INSERT, UPDATE, and DELETE

• Lab: Modify Data in a Delta Table

• Demo: Explore Version History and Time Travel

• Lab: Use Version History and Time Travel

• Demo: Ingest Data with CTAS and the Upload UI

• Lab: Ingest Data with CTAS

• Demo: Load Data Incrementally with COPY INTO

• Lab: Load Data Incrementally

• Demo: Build a Medallion Architecture Pipeline

• Lab: Build a Complete Medallion Pipeline

• Demo: Automate Your Pipeline with a Lakeflow Job

• Lab: Automate a Pipeline Job

• Demo: Bonus - Build a Declarative Pipeline with Spark Declarative Pipelines

• Lab: Bonus - Explore Your Declarative Pipeline Results

Upcoming Public Classes

Date
Time
Your Local Time
Language
Price
Jul 28
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Jul 29
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Aug 05
09 AM - 11 AM (Europe/London)
-
English
Free
Aug 11
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Aug 19
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Aug 26
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Aug 27
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Sep 02
09 AM - 11 AM (Europe/London)
-
English
Free
Sep 03
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Sep 08
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Sep 17
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Sep 24
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Sep 25
03 PM - 05 PM (Europe/London)
-
English
Free
Oct 07
09 AM - 11 AM (Europe/London)
-
English
Free
Oct 13
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Oct 21
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Oct 28
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Oct 30
09 AM - 11 AM (America/Los_Angeles)
-
English
Free

Public Class Registration

If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.

Private Class Request

If your company is interested in private training, please submit a request.

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Databricks Get Started Days (Data Engineering + Generative AI)

Get Started with Databricks for Data Engineering

In this course, you will learn basic skills that will allow you to use the Databricks Data Intelligence Platform to perform a simple data engineering workflow and support data warehousing endeavors. You will be given a tour of the workspace and be shown how to work with objects in Databricks such as catalogs, schemas, volumes, tables, compute clusters, and notebooks. You will then follow a basic data engineering workflow to perform tasks such as creating and working with tables, ingesting data into Delta Lake, transforming data through the medallion architecture, and using Databricks Workflows to orchestrate data engineering tasks. You’ll also learn how Databricks supports data warehousing needs through the use of Databricks SQL, Delta Live Tables, and Unity Catalog. With the purchase of a Databricks Labs subscription, the course also closes out with a comprehensive lab exercise to practice what you’ve learned in a live Databricks Workspace environment.

Get Started with Databricks for Generative AI

This course offers a practical introduction to the Mosaic AI platform, focusing on its key components and features for building and deploying generative AI systems. Participants will learn how Databricks facilitates the development of scalable generative AI solutions and explore Mosaic AI tools such as Vector Search, the Agent Framework, and MLflow’s generative AI capabilities for model tracking and logging. This course includes hands-on experience in constructing and evaluating Retrieval-Augmented Generation (RAG) pipelines, deploying generative AI agents, and leveraging evaluation frameworks to optimize performance. By the end of the course, learners will be equipped with the skills to design, deploy, and monitor common generative AI applications using Mosaic AI.

You can create a Databricks Free Edition account and try the follow-along demos in a hands-on environment.

Free
4h
instructor-led
Onboarding

Databricks Get Started Days (Lakehouse Architecture + Data Warehousing)

Get Started with Lakehouse Architecture on Databricks

In this course, you will explore the Databricks Data Intelligence Platform from the perspective of platform architecture, specifically related to the platform foundation in lakehouse architecture. You will learn about the scope, vision, and capabilities of a platform founded in lakehouse architecture, with a focus on how Databricks integrates with a cloud platform’s architecture. You’ll learn about the key features of a successful lakehouse implementation, specifically how to adhere to the well-architected lakehouse framework, which emphasizes structural excellence through specific dimensions, principles and best practices. You’ll also learn about data architecture strategy for the acceleration of data and AI endeavors.

Get Started with Databricks for Data Warehousing

This course provides a comprehensive overview of Databricks’ modern approach to data warehousing, highlighting how a data lakehouse architecture combines the strengths of traditional data warehouses with the flexibility and scalability of the cloud. You’ll learn about the AI-driven features that enhance data transformation and analysis on the Databricks Data Intelligence Platform. Designed for data warehousing practitioners, this course provides you with the foundational information needed to begin building and managing high-performant, AI-powered data warehouses on Databricks.

This course is designed for those starting out in data warehousing and those who would like to execute data warehousing workloads on Databricks. Participants may also include data warehousing practitioners who are familiar with traditional data warehousing techniques and concepts and are looking to expand their understanding of how data warehousing workloads are executed on Databricks.

You can create a Databricks Free Edition account and try the follow-along demos in a hands-on environment.

Free
4h
instructor-led
Onboarding

Databricks Get Started Days (Data Engineering + Machine Learning)

Get Started with Databricks for Data Engineering

In this course, you will learn basic skills that will allow you to use the Databricks Data Intelligence Platform to perform a simple data engineering workflow and support data warehousing endeavors. You will be given a tour of the workspace and be shown how to work with objects in Databricks such as catalogs, schemas, volumes, tables, compute clusters, and notebooks. You will then follow a basic data engineering workflow to perform tasks such as creating and working with tables, ingesting data into Delta Lake, transforming data through the medallion architecture, and using Databricks Workflows to orchestrate data engineering tasks. You’ll also learn how Databricks supports data warehousing needs through the use of Databricks SQL, Delta Live Tables, and Unity Catalog. With the purchase of a Databricks Labs subscription, the course also closes out with a comprehensive lab exercise to practice what you’ve learned in a live Databricks Workspace environment.

Get Started with Databricks for Machine Learning

In this course, you will develop the foundational skills needed to use the Databricks Data Intelligence Platform for executing basic machine learning workflows and supporting data science workloads. You will explore the platform from the perspective of a machine learning practitioner, covering topics such as feature engineering with Databricks Notebooks and model lifecycle tracking with MLflow. Additionally, you will learn about real-time model inference with Mosaic AI Model Serving and experience Databricks’ “glass box” approach to model development through AutoML. The course includes three instructor-led demonstrations, culminating in a comprehensive lab that reinforces the concepts covered in the demos.

You can create a Databricks Free Edition account and try the follow-along demos in a hands-on environment.

Free
4h
instructor-led
Onboarding

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.