Session

FanDuel Presents: Operating Databricks at Scale

Overview

ExperienceIn Person
TrackData Strategy
IndustryEnterprise Technology, Communications, Media & Entertainment, Financial Services
TechnologiesDatabricks SQL, Unity Catalog
Skill LevelIntermediate
DOWNLOAD SESSION SLIDES
As organizations adopt Databricks as their central lakehouse, the challenge shifts from implementation to operating the platform reliably, securely, and cost-effectively at scale. This session presents a platform engineering operating model built on a Govern, Build, Deploy, Optimize lifecycle that enables diverse teams while embedding governance and performance controls.These initiatives demonstrate the lifecycle in action at FanDuel:• Govern – Terraforming Databricks provisions workspaces, Unity Catalog, compute, and access as code, delivering consistent and auditable environments.• Build – Standardized PySpark frameworks accelerate migrations and ensure architectural consistency through reusable ingestion and transformation patterns.• Deploy – The Project Stargate Framework uses Databricks Asset Bundles and CI/CD for controlled, traceable promotion to production.• Optimize – Cost visibility and performance efficiency through segmentation and data-driven optimization.

Session Speakers

Errick Benson Peart

/Director, Data Engineering
FanDuel

Prabhjot Singh

/Data Engineering Manager
FanDuel