Data + AI Professional Workshop Series

This course provides a comprehensive introduction to Lakeflow Connect as a scalable and simplified solution for ingesting data into Databricks from a variety of data sources. You will begin by exploring the different types of connectors within Lakeflow Connect (Standard and Managed), learn about various ingestion techniques, including batch, incremental batch, and streaming, and then review the key benefits of Delta tables and the Medallion architecture.

You'll learn:

• Introduction to Data Engineering in Databricks
  • Data Engineering in Databricks
  • What is Lakeflow Connect?
  • Delta Lake Review
  • Exploring the Lab Environment
     
• Cloud Storage Ingestion with Lakeflow Connect Standard Connectors
  • Introduction to Data Ingestion from Cloud Storage
  • Appending Metadata Columns on Ingest
  • Working with the Rescued Data Column
  • Ingesting Semi-Structured Data: JSON
     
• Enterprise Data Ingestion with Lakeflow Connect Managed Connectors
  • Ingesting Enterprise Data into Databricks Overview
  • Enterprise Data Ingestion with Lakeflow Connect
     
• Ingestion Alternatives
  • Ingesting Data with Databricks Marketplace
  • Ingesting into Existing Delta Tables
  • Data Ingestion with MERGE INTO

In this Data Governance with Unity Catalog session, you'll learn concepts and perform labs that showcase workflows using Unity Catalog - Databricks' solution to data governance. We'll start off with a brief introduction to Unity Catalog, discuss fundamental data governance concepts, and then dive into a variety of topics including using Unity Catalog for data access control, managing external storage and tables, data segregation, and more.

What we'll cover:

• Data governance fundamentals & metastore navigation (demo + lab)
• Organizing data and upgrading tables to Unity Catalog
• Security, administration and fine-grained access control (demo + lab)
• Privileges, access patterns and data segregation
• Databricks Marketplace overview
• Lakehouse monitoring (demo)

This course introduces data professionals to the modern data warehousing capabilities of Databricks. Using the Databricks Data Intelligence Platform, you’ll learn how to ingest, transform, govern, and analyze data efficiently with the industry-standard TCP-DI dataset. The course also highlights Genie, Databricks’ natural language interface that makes data exploration intuitive and fast. By the end, you’ll gain the core skills to design, implement, and optimize a data warehouse on Databricks.

What we’ll cover:

1. Introduction to Databricks

• Platform Overview
• Unity Catalog for Governance
• SQL Warehouses (with Demo)

2. Data Ingestion and Transformation

• Ingestion Techniques
• Data Transformation
• Hands-on Demos: Ingesting & Exploring Data

3. Orchestration and Monitoring

• Workflows (with Demo)
• Monitoring & Tagging
• System Tables & Cost Optimization

4. Visualization and Insights

• AI/BI Overview
• Dashboards (Demo + Lab)

5. Genie for Natural Language Queries

• Introduction to Genie
• Genie Spaces (Demo + Lab)

6. Power BI Integration

• Connecting Databricks with Power BI
• Star Schema Overview

Master Databricks for business intelligence with hands-on training in AI/BI Dashboards and AI/BI Genie. In this course, you’ll learn to design powerful dashboards that deliver clear business insights, set up secure access for stakeholders, and manage these assets throughout their lifecycle. You’ll also explore AI/BI Genie Spaces to create and maintain self-service analytics environments, empowering teams with fast, intelligent data exploration — all powered by the Databricks Data Intelligence Engine.

AI/BI Dashboards

• Get Started Fast – Understand what dashboards can do and how they fit into your workflow
• Essential SQL Skills – Learn just the SQL you need to prep data for dashboards
• Build Your Dataset – Design clean, optimized data sources
• Visualize Your Insights – Create charts and summary stats that matter
• Boost with AI – Make dashboards smarter with AI features
• Make It Interactive – Add filters and parameters
• Collaborate Securely – Share with the right people
• Keep It Running – Manage updates and lifecycle in production
• Hands-On Lab – Build and refine your own dashboard

AI/BI Genie

• Discover Genie Spaces – Enable self-service analytics for your team
• Create Your Space – Build interactive data environments
• Share With Your Team – Control access and collaborate effectively
• Maintain Performance – Keep Genie Spaces accurate and fast
• Hands-On Lab – Develop and manage your own Genie Space