SESSION
Databricks Workflows: Practical How-Tos and Demos (repeated)
OVERVIEW
EXPERIENCE | In Person |
---|---|
TYPE | Breakout |
TRACK | Data Engineering and Streaming |
INDUSTRY | Energy and Utilities, Enterprise Technology, Manufacturing |
TECHNOLOGIES | Orchestration |
SKILL LEVEL | Intermediate |
DURATION | 40 min |
DOWNLOAD SESSION SLIDES |
Databricks Workflows provide a simple and visual mechanism to orchestrate your data pipelines. In this session, we will cover some of the best practices and demos on how to get the most out of your Data Intelligence Platform. We will cover topics including:
- Serverless jobs - building for scale and optimizing for cost repairing jobs - isolating, fixing, and rerunning failures efficiently for better observability
- Setting up notifications for late jobs
- Event-driven integrations
- Webhook for jobs
- Trigger your jobs effectively
- Table and file arrival triggers
We will also showcase some comparisons to other orchestrators so you can make the best-informed choice for high efficiency, better TCO, and a better authoring experience in Databricks Workflows.
SESSION SPEAKERS
Prashanth Babu Velanati Venkata
/Product Specialist
Databricks