Skip to main content

Get Started with Databricks for Data Engineering

This course introduces the foundational skills needed to perform a basic data engineering workflow on the Databricks Data Intelligence Platform. You will explore the workspace, work with Unity Catalog, and learn the day-to-day building blocks a data engineer uses on Databricks.


The course follows a hands-on path. You start by getting oriented in the workspace, then work through paired Demo and Lab notebooks for each topic. Demos walk you through a concept with the instructor or a guided notebook; Labs ask you to apply what you just saw on your own.


The content covers:

• The Databricks Data Intelligence Platform and how the Databricks workspace, Unity Catalog, and notebooks fit together.

• Creating and managing Delta Lake tables.

• Modifying data with INSERT, UPDATE, and DELETE.

• Exploring version history and time travel on Delta tables.

• Ingesting data with Lakeflow Connect options: CTAS, the Upload UI, and COPY INTO.

• Building a Medallion Architecture pipeline that transforms data through Bronze, Silver, and Gold layers.

• Automating pipelines with Lakeflow Jobs.

• (Bonus) Building a declarative pipeline with Spark Declarative Pipelines.


You can create a Databricks Free Edition account and try the follow-along demos in a hands-on environment.


Languages Available: English | 日本語 | Português BR | 한국어 | Español française

Skill Level
Onboarding
Duration
2h
Prerequisites

• Basic familiarity with cloud data platforms. You understand what a database, table, and query are at a conceptual level.

• Working knowledge of SQL. You can read and write SELECT statements with WHERE, GROUP BY, and aggregates, and you understand INSERT, UPDATE, and DELETE.

• General awareness of data engineering concepts like data ingestion, transformation, and pipelines is helpful but not required — the course covers the basics.

Outline

Get Started with Data Engineering on Databricks

• Databricks Data Intelligence Platform

• Demo: Databricks Workspace Walkthrough

• Demo: Find Your Data and Create a table

• Lab: Find and Create Tables

• Demo: Modify Data with INSERT, UPDATE, and DELETE

• Lab: Modify Data in a Delta Table

• Demo: Explore Version History and Time Travel

• Lab: Use Version History and Time Travel

• Demo: Ingest Data with CTAS and the Upload UI

• Lab: Ingest Data with CTAS

• Demo: Load Data Incrementally with COPY INTO

• Lab: Load Data Incrementally

• Demo: Build a Medallion Architecture Pipeline

• Lab: Build a Complete Medallion Pipeline

• Demo: Automate Your Pipeline with a Lakeflow Job

• Lab: Automate a Pipeline Job

• Demo: Bonus - Build a Declarative Pipeline with Spark Declarative Pipelines

• Lab: Bonus - Explore Your Declarative Pipeline Results

Upcoming Public Classes

Date
Time
Your Local Time
Language
Price
Jul 28
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Jul 29
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Aug 05
09 AM - 11 AM (Europe/London)
-
English
Free
Aug 11
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Aug 19
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Aug 26
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Aug 27
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Sep 02
09 AM - 11 AM (Europe/London)
-
English
Free
Sep 03
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Sep 08
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Sep 17
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Sep 24
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Sep 25
03 PM - 05 PM (Europe/London)
-
English
Free
Oct 07
09 AM - 11 AM (Europe/London)
-
English
Free
Oct 13
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Oct 21
09 AM - 11 AM (America/Los_Angeles)
-
English
Free
Oct 28
12 PM - 02 PM (Asia/Singapore)
-
English
Free
Oct 30
09 AM - 11 AM (America/Los_Angeles)
-
English
Free

Public Class Registration

If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.

Private Class Request

If your company is interested in private training, please submit a request.

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Databricks Get Started Days (Data Engineering + SQL Analytics and BI)

Get Started with Databricks for Data Engineering

In this course, you will learn basic skills that will allow you to use the Databricks Data Intelligence Platform to perform a simple data engineering workflow and support data warehousing endeavors. You will be given a tour of the workspace and be shown how to work with objects in Databricks such as catalogs, schemas, volumes, tables, compute clusters and notebooks. You will then follow a basic data engineering workflow to perform tasks such as creating and working with tables, ingesting data into Delta Lake, transforming data through the medallion architecture, and using Databricks Workflows to orchestrate data engineering tasks. You’ll also learn how Databricks supports data warehousing needs through the use of Databricks SQL, Delta Live Tables, and Unity Catalog. With the purchase of a Databricks Labs subscription, the course also closes out with a comprehensive lab exercise to practice what you’ve learned in a live Databricks Workspace environment.

Get Started with SQL Analytics and BI on Databricks

In this course, you will learn basic skills that will allow you to use the Databricks Data Intelligence Platform to perform a simple data analytics workflow and support data warehousing endeavors. You will be given a tour of the workspace and be shown how to work with data objects in Databricks such as catalogs, schemas, tables, compute clusters, notebooks, and dashboards. You will then follow a basic data analytics workflow to perform tasks such as manipulating data using Databricks SQL, leveraging Delta Lake version logs to time travel, creating dashboards within the platform, and creating Genie Spaces for data exploration using natural language prompts. You will also learn how Databricks supports data warehousing needs through the use of Databricks SQL, Delta Live Tables, and Unity Catalog. 

You can create a Databricks Free Edition account and try the follow-along demos in a hands-on environment.

Languages Available: English | 日本語 | Português BR | 한국어 | Español | française

Free
4h
instructor-led
Onboarding

Databricks Get Started Days (Data Engineering + Generative AI)

Get Started with Databricks for Data Engineering

In this course, you will learn basic skills that will allow you to use the Databricks Data Intelligence Platform to perform a simple data engineering workflow and support data warehousing endeavors. You will be given a tour of the workspace and be shown how to work with objects in Databricks such as catalogs, schemas, volumes, tables, compute clusters, and notebooks. You will then follow a basic data engineering workflow to perform tasks such as creating and working with tables, ingesting data into Delta Lake, transforming data through the medallion architecture, and using Databricks Workflows to orchestrate data engineering tasks. You’ll also learn how Databricks supports data warehousing needs through the use of Databricks SQL, Delta Live Tables, and Unity Catalog. With the purchase of a Databricks Labs subscription, the course also closes out with a comprehensive lab exercise to practice what you’ve learned in a live Databricks Workspace environment.

Get Started with Databricks for Generative AI

This course offers a practical introduction to the Mosaic AI platform, focusing on its key components and features for building and deploying generative AI systems. Participants will learn how Databricks facilitates the development of scalable generative AI solutions and explore Mosaic AI tools such as Vector Search, the Agent Framework, and MLflow’s generative AI capabilities for model tracking and logging. This course includes hands-on experience in constructing and evaluating Retrieval-Augmented Generation (RAG) pipelines, deploying generative AI agents, and leveraging evaluation frameworks to optimize performance. By the end of the course, learners will be equipped with the skills to design, deploy, and monitor common generative AI applications using Mosaic AI.

You can create a Databricks Free Edition account and try the follow-along demos in a hands-on environment.

Free
4h
instructor-led
Onboarding

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.