Serverless Compute at Petabyte Scale: Latest Launches, Roadmap, and Deloitte's Migration Story
Overview
| Experience | In Person |
|---|---|
| Track | Data Engineering & Streaming |
| Industry | Enterprise Technology, Consulting & Services |
| Technologies | AI/BI, Lakeflow |
| Skill Level | Beginner |
Serverless Compute for Notebooks, Jobs, and Pipelines has reached a turning point. What started as a convenience for ad hoc workloads now runs petabyte-scale production and mission-critical SLAs at some of the largest Databricks customers. This session covers the most recent launches across runtime, performance, and cost for Notebooks, Jobs, and Pipelines, as well as upcoming. Then we share how Deloitte moved its global audit data platform, serving 60,000+ auditors with 20,000+ daily jobs across three geos, from classic compute to serverless: the migration path, the architecture changes, and the results. If you have been waiting for serverless to be ready for your hardest and largest workloads, this is the session to recalibrate.
Session Speakers
Roland Fäustlin
/Product Manager
Databricks
Santosh Dandey
/Enterprise Architect
Deloitte