Real Time Learning and Analyzing: SWIM Data Ingestion on Databricks Brings Situational Awareness and Decision-Making Speed
Overview
Experience | In Person |
---|---|
Type | Breakout |
Track | Data Engineering and Streaming |
Industry | Travel and Hospitality |
Technologies | Databricks Workflows, Partner Connect, Databricks Apps |
Skill Level | Intermediate |
Duration | 40 min |
The airline industry faces a critical challenge: how to leverage vast volumes of operational data to improve revenue forecasting, optimize marketing strategies and enhance customer loyalty. United Airlines’ Passenger Revenue Accounting (PRA) team encountered these issues, working with massive datasets from SIRAX that were difficult to process and analyze efficiently.
This session will explore how United Airlines collaborated with Impetus and Databricks to develop an innovative solution. By integrating SIRAX data and leveraging Spark-based processing, the team achieved high-speed analysis of over 20 million rows of data in under ten minutes. The solution included automated health checks to minimize anomalies and a scalable, user-friendly revenue forecasting dashboard, reducing operational costs by 50% and accelerating data-to-insight workflows.
We’ll provide a walkthrough of the technical components, such as ingestion process, real-time data validation and dynamic data modeling.
Session Speakers
IMAGE COMING SOON
Diana Johnson
/Director - strategic accounts
Impetus
IMAGE COMING SOON
Sanjay Nair
/Managing Director & Head of Data and AI
United Airlines