Skip to main content

Catalog Management and Data Organization

In this course, you will learn how to design, implement, and govern catalog structures and large-scale data organization on the Databricks Data Intelligence Platform. It offers a comprehensive view of Unity Catalog as the centralized governance layer for an enterprise lakehouse. Divided into five modules, it begins by placing Unity Catalog within the cloud deployment model — covering the Account Console, metastore creation, and the administrator role hierarchy. You will then translate organizational topology (business units, regions, and dev/QA/prod environments) into a scalable catalog and schema design using naming conventions, ownership patterns, and MANAGE delegation. The course then covers secure storage integration with storage credentials, external locations, the managed-storage hierarchy, managed versus external tables, and UC Volumes for non-tabular data. Next, you will apply access patterns and isolation strategies — the three-level GRANT chain, workspace-catalog binding, and schema-level Attribute-Based Access Control (ABAC) policies — to enforce fine-grained data protection at scale. Finally, the course closes with best practices for catalog design, automation, least-privilege permissions, and group-based access management.


Note: For SCORM lecture files, please ensure that you close the SCORM window after completing the content. Do not click the ‘Next Lesson’ button, as doing so may prevent the SCORM module from being marked as complete.

Skill Level
Associate
Duration
2h
Prerequisites

In this course, the content was developed for participants with these skills/knowledge/abilities:  

• Familiarity with the Databricks Data Intelligence Platform and basic workspace operations (creating clusters and SQL warehouses, running SQL and Python in notebooks, basic notebook navigation)

• Working knowledge of Unity Catalog fundamentals, including the three-level namespace (metastore → catalog → schema → table) and the core securable objects (tables, views, volumes, models)

• Hands-on experience with Unity Catalog–enabled workspaces, including creating and managing catalogs, schemas, and tables via SQL

• Solid understanding of identity and access management concepts (users, groups, service principals, authentication, authorization) and the difference between account-level and workspace-level administration

• Working knowledge of data governance principles — access control, data classification, compliance, and audit — and how they map to platform features

• Familiarity with cloud object storage concepts (S3, ADLS, or GCS), including IAM roles, bucket-level paths, and the role of storage credentials in cross-service access

• Introductory familiarity with Delta Lake (managed vs external tables, Delta lifecycle) and Lakeflow for orchestrating data workflows

• Practical experience with enterprise architecture in larger organizations — multi-business-unit topology, regional data residency, and dev/QA/prod environment separation

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Data Engineer

Automated Deployment with Declarative Automation Bundles - Mandarin Chinese

本课程全面介绍了 DevOps 原则及其在 Databricks 项目中的应用。课程首先概述了核心 DevOps、DataOps、持续集成(CI)、持续部署(CD)和测试的基本概念,并探讨了如何将这些原则应用于数据工程管道。

课程随后聚焦于 CI/CD 流程中的持续部署,介绍用于项目部署的工具,包括 Databricks REST API、SDK 和 CLI。您将了解声明式自动化包(DAB)及其在 CI/CD 流程中的作用,深入学习其关键组件、文件夹结构,以及它们如何简化在 Databricks 中跨各种目标环境的部署流程。您还将学习如何使用 Databricks CLI 为多个具有不同配置的环境添加变量、修改、验证、部署和执行声明式自动化包。

最后,课程介绍如何将 Visual Studio Code 作为交互式开发环境(IDE),用于在本地构建、测试和部署声明式自动化包,从而优化开发流程。课程最后介绍如何使用 GitHub Actions 自动化部署管道,以增强声明式自动化包的 CI/CD 工作流。

完成本课程后,您将具备使用声明式自动化包自动化 Databricks 项目部署的能力,并能够通过 DevOps 实践提升工作效率。

注意:

Databricks Academy 正在将所有自定进度课程从视频讲座转为更简洁的 PDF 格式,其中包含幻灯片和讲义。请注意,演示视频仍将以原始格式提供。我们非常希望听到您对这一变化的看法,因此请通过课程末尾的课程调查分享您的反馈。感谢您成为我们学习社区的一员!本课程是 ‘Advanced Data Engineering with Databricks’ 系列的第四门课程。

Languages Available: English | 日本語 | 한국어

Free
2h
Professional

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.