How to Bridge the Gap Between No-Code and Pro-Code with Lakeflow Designer

Data engineering has a bottleneck: there are too many pipelines to build, not enough engineers to build them. Lakeflow Designer changes the equation by giving SQL analysts and citizen developers a visual, no-code interface to create production-grade ETL pipelines, backed by the same engine that powers Lakeflow Spark Declarative Pipelines (SDP).

This session explores the full Lakeflow spectrum. We'll start with Lakeflow Designer's drag-and-drop canvas and GenAI assistant, showing how a business analyst can build a medallion pipeline in minutes without writing code. Then we'll show how a data engineer extends that same pipeline with custom Python logic, data quality expectations stored in Unity Catalog, and Data Quality Monitoring with anomaly detection.

We'll demonstrate how Lakeflow Connect ingests from sources like Salesforce and PostgreSQL, how SDPs handle the transformation layer, and how Jobs orchestrate.

You'll see how visual and code-based interfaces coexist, enabling collaboration.