Session
Building End-to-End ingestion with Lakeflow Connect
Overview
| Experience | In Person |
|---|---|
| Track | Data Engineering & Streaming |
| Industry | Healthcare & Life Sciences, Retail & Consumer Goods, Financial Services |
| Technologies | Lakeflow |
| Skill Level | Intermediate |
Data engineers spend far too much time maintaining fragile pipelines across a fragmented landscape of databases, SaaS applications, and file sources. In this technical session, we'll build a complete ingestion platform live on stage, while spotlighting new features and best practices for security, performance, and operational simplicity.
We'll dive into:
- Application ingestion: SaaS sources like Salesforce and Workday, plus how community connectors extend Lakeflow Connect to sources with no out-of-the-box connector.
- Database ingestion: On-premises and cloud databases like Oracle — from connectivity and network security to choosing the right ingestion pattern and protecting production systems.
- Infrastructure as code: How to package every connector and pipeline into a single Declarative Automation Bundle so that your pipelines are reproducible, reviewable, and production-ready.
Stop managing infrastructure and start delivering data.
Session Speakers
Peter Pogorski
/Staff Product Manager
Databricks
Sonia Bendre
/Associate Product Manager
Databricks