Session

Replacing Legacy Data Dumps with Governed Delta Sharing: A Real-World Provider and Consumer Story

Overview

ExperienceIn Person
TrackData Sharing & Collaboration
IndustryEnergy & Utilities
TechnologiesDelta Sharing, Unity Catalog
Skill LevelAdvanced
Many data-sharing implementations begin with full database exports dropped into object storage, leaving consumers to navigate raw CDC logs, weak governance, and fragile manual processes.This session shares how Kraken and Meridian replaced that model with a governed, cross-cloud Delta Sharing architecture on Databricks. Kraken moved from sharing parquet files and CDC logs to publishing curated, modelled Delta tables through Databricks-managed cross-cloud Delta Sharing. Structured datasets, controlled permissions, and Infrastructure-as-Code governance enable repeatable, auditable deployment.Meridian receives Delta Shares directly into Databricks without building bespoke ingestion pipelines. More than 300 tables were available almost immediately, delivered at a 60-minute cadence. Shares surface as read-only sources via Unity Catalog, with DAB- and DLT-driven promotion into integrated layers.The result: reduced operational risk, lower TCO, and faster access to trusted data.

Session Speakers

Speaker placeholderIMAGE COMING SOON

Leigh Couper

/Head of Retail Digital & Data
Meridian Energy

Youcef Kadri

/Lead Data Engineer
Kraken