Databricks on Databricks: Path to Unified Governance (repeat)
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Breakout |
TRACK | Data Governance |
INDUSTRY | Enterprise Technology, Retail and CPG - Food, Financial Services |
TECHNOLOGIES | AI/Machine Learning, Delta Lake, Governance |
SKILL LEVEL | Beginner |
DURATION | 40 min |
This session is repeated.
Governance in cloud platforms is about the intersection of humans (the employees, often engineers), cloud resources and assets (data). There are many different roles humans have with different responsibilities. There is a range of assets by sensitivity and volume. Resource consumption dramatically ranges from small to very large, depending on the task. Therefore, the goal of any data governance journey is to enable the right people to have access to the assets and resources needed to accomplish a specific purpose. This session is an inside look by our very own Data Team at how we accomplish scalable Data Governance at Databricks. We will cover the challenges, solutions, our opinionated ways of leveraging Unity Catalog, and common pitfalls to avoid.
SESSION SPEAKERS
Bruce Wong
/Head of Data Platform
Databricks
Romit Jadhwani
/Sr. Director, Data
Databricks