SESSION

Rise of the Medallion Mesh

OVERVIEW

EXPERIENCEIn Person
TYPEBreakout
TRACKData Warehousing - Analytics and BI
INDUSTRYEnterprise Technology
TECHNOLOGIESDelta Lake, ETL, SQL Analytics / BI / Visualizations
SKILL LEVELIntermediate
DURATION40 min

This session is repeated.

 

Organizations today face a significant challenge: the loss of productivity due to data preparation issues. This talk explores innovative solutions from successful customers in data architecture, focusing on the Medallion Mesh pattern. We delve into the Medallion architecture, born from Delta Lake, which organizes data into Bronze, Silver, and Gold layers, offering a structured approach to data management. Combined with Data Mesh, a decentralized framework promoting domain-based data product creation, this approach addresses the bottlenecks in large organizations. The talk highlights the integration of dbt for pipeline management, emphasizing how the Medallion Mesh pattern democratizes data access, fosters self-service, and ensures scalability. We'll explore real-world applications and discuss how to tailor these patterns to diverse organizational needs, ensuring a flexible, efficient, and future-proof data architecture.

SESSION SPEAKERS

Franco Patano

/Lead Product Specialist
Databricks