Inside our Lakeflow Journey at SEGA: Scaling Streaming Analytics Across Titles
Overview
| Experience | In Person |
|---|---|
| Track | Data Engineering & Streaming |
| Industry | Communications - Media & Entertainment |
| Technologies | AI/BI, Lakeflow, Unity Catalog |
| Skill Level | Intermediate |
At SEGA Europe, we process billions of game telemetry events daily to power real-time analytics for live ops, player experience optimisation, and business intelligence. We have rebuilt our streaming platform on Lakeflow Spark Declarative Pipelines, moving from fragile, manually managed jobs to a resilient, self-healing lakehouse architecture. This approach was battle-tested during the launch of Football Manager 2026, where scale and reliability were critical.This session shares our production journey with Lakeflow—the wins, lessons, and unexpected challenges of operating at gaming scale. We’ll cover our migration from legacy streaming infrastructure, achieving sub-minute latency, and handling evolving event schemas. Topics include stream fan-out from Kinesis to Bronze, schema evolution, late and out-of-order events, data quality checks, performance tuning, and cost control. We’ll also share quantified results from FM26 and practical patterns for teams evaluating Lakeflow at scale.
Session Speakers
Felix Baker
/Head of Data Services
SEGA Europe Limited
Sanjay Ashok
/Solutions Architect
Databricks