Session

Serverless Compute at Petabyte Scale: Latest Launches, Roadmap, and Deloitte's Migration Story

Overview

ExperienceIn Person
TrackData Engineering & Streaming
IndustryEnterprise Technology, Consulting & Services
TechnologiesAI/BI, Lakeflow
Skill LevelBeginner

 

Serverless Compute for Notebooks, Jobs, and Pipelines has reached a turning point. What started as a convenience for ad hoc workloads now runs petabyte-scale production and mission-critical SLAs at some of the largest Databricks customers. This session covers the most recent launches across runtime, performance, and cost for Notebooks, Jobs, and Pipelines, as well as upcoming. Then we share how Deloitte moved its global audit data platform, serving 60,000+ auditors with 20,000+ daily jobs across three geos, from classic compute to serverless: the migration path, the architecture changes, and the results. If you have been waiting for serverless to be ready for your hardest and largest workloads, this is the session to recalibrate.

Session Speakers

Speaker placeholderIMAGE COMING SOON

Roland Fäustlin

/Product Manager
Databricks

Speaker placeholderIMAGE COMING SOON

Santosh Dandey

/Enterprise Architect
Deloitte