Real-time Data, Real Business Results: An Introduction to Streaming on Databricks
Overview
| Experience | In Person |
|---|---|
| Track | Data Engineering & Streaming |
| Industry | Healthcare & Life Sciences, Manufacturing, Financial Services |
| Technologies | Lakeflow |
| Skill Level | Beginner |
Real-time data isn't just a technical aspiration, it's a competitive advantage. Whether you're detecting fraud in milliseconds, personalizing a customer experience mid-session, or attributing an ad impression to a conversion in real time, the gap between "fast enough" and "actually fast" has real business consequences.This session introduces Real-Time Mode and TransformWithState in Apache Spark™ Structured Streaming, Databricks' answer to ultra-low latency stream processing without the overhead of a separate streaming engine. We’ll walkthrough how these capabilities work, what problems they solve, and when to use them.Industry-leading customers, such as Coinbase, needed millisecond-level guarantees for financial transaction processing; DraftKings, whose live betting platform demands real-time odds calculation at scale; and MakeMyTrip, processing travel signals in real time to serve better search results to millions of users. We'll also unpack the ad attribution use case— a domain where latency directly impacts revenue attribution accuracy and where Real-Time Mode is proving transformative.
Session Speakers
Navneeth Nair
/Staff Product Manager
Databricks