The Future of Data Orchestration: Asset-Based Orchestration
Overview
Data orchestration is a core component for any batch data processing platform and we’ve been using patterns that haven't changed since the 1980s. In this talk, I’ll be introducing a new pattern and way of thinking for data orchestration known as asset-based orchestration, with data freshness sensors to trigger pipelines. In this session we will demo this new pattern using popular tools of the modern data stack - dbt, Airbyte, Dagster, and Databricks.
Type
- Lightning Talk
Experience
- In Person
Track
- Data Engineering
Industry
- Media and Entertainment
Difficulty
- Beginner
Duration
- 20 min
Session Speakers

Sandy Ryza
Lead Engineer on the Dagster Project
Elementl
Don't miss this year's event!
Register now