Streaming Data With DLT and Databricks Workflows

Let's analyze tweets from Data + AI Summit 2022! Modern data engineering requires a more advanced data lifecycle for data ingestion, transformation and processing. In this session, you can learn how the Databricks Lakehouse Platform provides an end-to-end data engineering solution that automates the complexity of building and maintaining data pipelines. Enjoy a fun, live, streaming data example with a Twitter data stream, Databricks Auto Loader and DLT as well as Hugging Face sentiment analysis.

 

Note - at Data + AI Summit in June 2025, Databricks released Lakeflow. Lakeflow unifies Data Engineering with Lakeflow Connect, Lakeflow Declarative Pipelines (previously known as DLT), and Lakeflow Jobs (previously known as Workflows).