Session

Inside our Lakeflow Journey at SEGA: Scaling Streaming Analytics Across Titles

Overview

ExperienceIn Person
TrackData Engineering & Streaming
IndustryCommunications - Media & Entertainment
TechnologiesAI/BI, Lakeflow, Unity Catalog
Skill LevelIntermediate

At SEGA Europe, we process billions of game telemetry events daily to power real-time analytics for live ops, player experience optimisation, and business intelligence. We have rebuilt our streaming platform on Lakeflow Spark Declarative Pipelines, moving from fragile, manually managed jobs to a resilient, self-healing lakehouse architecture. This approach was battle-tested during the launch of Football Manager 2026, where scale and reliability were critical.This session shares our production journey with Lakeflow—the wins, lessons, and unexpected challenges of operating at gaming scale. We’ll cover our migration from legacy streaming infrastructure, achieving sub-minute latency, and handling evolving event schemas. Topics include stream fan-out from Kinesis to Bronze, schema evolution, late and out-of-order events, data quality checks, performance tuning, and cost control. We’ll also share quantified results from FM26 and practical patterns for teams evaluating Lakeflow at scale.

Session Speakers

Speaker placeholderIMAGE COMING SOON

Felix Baker

/Head of Data Services
SEGA Europe Limited

Speaker placeholderIMAGE COMING SOON

Sanjay Ashok

/Solutions Architect
Databricks