Session

Modern Data Modeling at Scale: Advanced Patterns

Overview

ExperienceIn Person
TrackData Warehousing
IndustryEnterprise Technology
TechnologiesDatabricks SQL
Skill LevelAdvanced

Unlock the truth behind data modeling in Databricks. This session will tackle the top 10 myths surrounding relational and dimensional data modeling. Attendees will gain a clear understanding of what Databricks Lakehouse truly supports today, including how to leverage primary and foreign keys, identity columns for surrogate keys, column-level data quality constraints and much more. This session will talk through the lens of medallion architecture, explaining how to implement data models across Bronze, Silver and Gold tables. Whether you’re migrating from a legacy warehouse or building new analytics solutions, you’ll leave equipped to fully leverage Databricks’ capabilities, and design scalable, high-performance data models for enterprise analytics.

Session Speakers

Speaker placeholderIMAGE COMING SOON

Kyle Hale

/DBSQL Product Specialist
Databricks

Shannon Barrow

/Principal SA and Practice Lead
Databricks

Full Summary

Modern data modeling at scale: Ten truths for the lakehouse era

Data modeling has not faded, it has become more consequential. The session argues that dimensional discipline, governed semantics, and smart physical layout are the quiet foundations for trustworthy AI, BI, and operational analytics on the Databricks Platform. The principles behind data modeling matter even more as agents enter production, and understanding what a data lakehouse architecture encompasses shows why these investments compound on a unified platform.

FAQ


Constraints are informational and not enforced at write time. The optimizer only uses them for join rewrites when you add the RELY keyword, which signals you have validated integrity with data quality checks or upstream guarantees.

A BI tool's layer serves a single tool. Unity Catalog Metric Views are governed catalog objects that every consumer queries, including Databricks SQL, AI/BI Dashboards, Genie, and partner BI tools, so one definition drives consistent answers across agents and dashboards.

Turn on predictive optimization. It automatically runs OPTIMIZE, VACUUM, and ANALYZE on Unity Catalog managed tables, which often cuts storage spend significantly because many teams do not vacuum regularly.

Yes. Both already share Parquet and deletion vectors, and the roadmap is a unified metadata layer co-designed with both communities. External writes to managed Delta Lake are in beta and credential vending is generally available, so interoperability keeps expanding.

Lakehouse RT is a real-time optimized warehouse type that delivers low-latency analytics with performance isolation, over the same single copy of data in open formats. It is positioned at the same price as Databricks SQL and requires no migration.