HomepageData + AI Summit 2024 Logo
June 10–13, 2024
San Francisco + Virtual
  • Sessions
  • 2024 Call for Presentations
Apply to speak

The Future of Data Orchestration: Asset-Based Orchestration

Wednesday, June 28 @1:00 PM
Attending in person? Add to your schedule ↗

Overview

Data orchestration is a core component for any batch data processing platform and we’ve been using patterns that haven't changed since the 1980s. In this talk, I’ll be introducing a new pattern and way of thinking for data orchestration known as asset-based orchestration, with data freshness sensors to trigger pipelines. In this session we will demo this new pattern using popular tools of the modern data stack - dbt, Airbyte, Dagster, and Databricks.


Type

  • Lightning Talk

Experience

  • In Person

Track

  • Data Engineering

Industry

  • Media and Entertainment

Difficulty

  • Beginner

Duration

  • 20 min
Download session slides

Session Speakers

Headshot of Sandy Ryza

Sandy Ryza

Lead Engineer on the Dagster Project

Elementl

Don't miss this year's event!

Register now