Session
Sponsored by: Accenture | From Pipelines to Agents: Rethinking Data Engineering for Autonomous Systems
Overview
| Experience | In Person |
|---|---|
| Track | Data Engineering & Streaming |
| Industry | Healthcare & Life Sciences, Manufacturing, Financial Services |
| Technologies | Delta Sharing, Lakeflow, Lakebase |
| Skill Level | Intermediate |
The next evolution of data engineering isn’t incremental—it’s autonomous. In this session, we challenge the traditional notion of pipelines and introduce an agentic model where data systems can reason, adapt, and act. Using Databricks as the foundation, we explore how agentic AI enables dynamic orchestration, intelligent error handling, and continuous optimization across the data lifecycle to build and run a complete data intelligence platform. We’ll share practical design patterns, lessons learned, and the trade-offs organizations must navigate as they move toward self-evolving data platforms—balancing autonomy with control, and innovation with governance.
Session Speakers
Chintan Shah
/Group Manager
Avanade
Abderrahmane FILALI
/Group Manager, Data architecture Lead
Avanade