Architecting Data Warehouses for Large-Scale Deployments
This course covers performance optimization, cost control, and security for large-scale data warehousing deployments.
This course is designed for Data Warehousing practitioners responsible for managing Databricks environments serving hundreds or thousands of users across multiple business units. You will gain the skills necessary to efficiently scale data warehousing operations while maintaining high performance, cost-effectiveness, and compliance with security standards.
Note: Databricks Academy is transitioning to a notebook-based format for classroom sessions within the Databricks environment, discontinuing the use of slide decks for lectures. You can access the lecture notebooks in the Vocareum lab environment.
In this course, the content was developed for participants with these skills/knowledge/abilities:
• SQL proficiency
• Data warehousing or Data platform architecture or management experience
• General cloud experience and understanding
Outline
1. Efficient Data Ingestion and Storage
• Data Architecture at Scale Introduction
• Data Warehouse Ingestion at Scale
• Demo: Ingestion and Transformation at Scale using Lakeflow
• Lab: Ingestion and Transformation using Lakeflow
• Lakehouse Federation and Foreign Catalogs
2. Multi-Workspace Strategy
• Databricks Accounts and Workspaces Overview
• Architecting for Multiple Workspaces
• Architecting Unity Catalog for Large Scale Environments
• Data Sharing in Large Scale Environments
3. Security and Governance at Scale
• Data Warehouse Enterprise Security
• Securing Data using Unity Catalog
• Demo: Implementing FGAC in UC
• Lab: Applying Governance at Scale using ABAC
4. Identity and Administration
• Databricks Identities
• Deploying Databricks Solutions in the Enterprise
• Demo: Deploying Solutions using DABs and GitOps
• Auditing and Monitoring Databricks
Upcoming Public Classes
Date | Time | Your Local Time | Language | Price |
|---|---|---|---|---|
Nov 18 | 09 AM - 01 PM (America/Los_Angeles) | - | English | $750.00 |
Dec 16 | 01 PM - 05 PM (Europe/Paris) | - | English | $750.00 |
Jan 27 | 09 AM - 01 PM (Asia/Singapore) | - | English | $750.00 |
Jan 27 | 01 PM - 05 PM (America/New_York) | - | English | $750.00 |
Public Class Registration
If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.
Private Class Request
If your company is interested in private training, please submit a request.
Registration options
Databricks has a delivery method for wherever you are on your learning journey
Self-Paced
Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos
Register now
Instructor-Led
Public and private courses taught by expert instructors across half-day to two-day courses
Register now
Blended Learning
Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase
Purchase now
Skills@Scale
Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details
