Session

FanDuel Presents: Operating Databricks at Scale

Register or Login

Overview

ExperienceIn Person
TrackData Strategy
IndustryEnterprise Technology, Communications, Media & Entertainment, Financial Services
TechnologiesDatabricks SQL, Unity Catalog
Skill LevelIntermediate
As organizations adopt Databricks as their central lakehouse, the challenge shifts from implementation to operating the platform reliably, securely, and cost-effectively at scale. This session presents a platform engineering operating model built on a Govern, Build, Deploy, Optimize lifecycle that enables diverse teams while embedding governance and performance controls.These initiatives demonstrate the lifecycle in action at FanDuel:• Govern – Terraforming Databricks provisions workspaces, Unity Catalog, compute, and access as code, delivering consistent and auditable environments.• Build – Standardized PySpark frameworks accelerate migrations and ensure architectural consistency through reusable ingestion and transformation patterns.• Deploy – The Project Stargate Framework uses Databricks Asset Bundles and CI/CD for controlled, traceable promotion to production.• Optimize – Cost visibility and performance efficiency through segmentation and data-driven optimization.

Session Speakers

Errick Benson Peart

/Director, Data Engineering
FanDuel

Prabhjot Singh

/Data Engineering Manager
FanDuel