Spark Declarative Pipelines (SDP) Avionics Demo

What you’ll learn

Learn to build a Spark Declarative Pipeline using Databricks Free Edition. The example is using real-time flight data from the OpenSky Network. Frank shows you how to ingest billions of real-time avionics events, build declarative pipelines and use AI-driven analytics with natural language queries for instant insights.

Recommended

<p>Spark Declarative Pipelines (DAIS 2025 Keynote)</p>

On-Demand Video

Spark Declarative Pipelines (DAIS 2025 Keynote)

<p>Introducing Lakeflow Designer</p>

On-Demand Video

Introducing Lakeflow Designer

<p>Data Engineering With Lakeflow</p>

On-Demand Video

Data Engineering With Lakeflow

Ready to get started?