SESSION

Databricks Workflows: Practical How-Tos and Demos (repeated)

OVERVIEW

EXPERIENCEIn Person
TYPEBreakout
TRACKData Engineering and Streaming
INDUSTRYEnergy and Utilities, Enterprise Technology, Manufacturing
TECHNOLOGIESOrchestration
SKILL LEVELIntermediate
DURATION40 min

Databricks Workflows provide a simple and visual mechanism to orchestrate your data pipelines. In this session, we will cover some of the best practices and demos on how to get the most out of your Data Intelligence Platform. We will cover topics including:

 

  • Serverless jobs - building for scale and optimizing for cost repairing jobs - isolating, fixing, and rerunning failures efficiently for better observability
  • Setting up notifications for late jobs
  • Event-driven integrations
  • Webhook for jobs
  • Trigger your jobs effectively
  • Table and file arrival triggers

 

We will also showcase some comparisons to other orchestrators so you can make the best-informed choice for high efficiency, better TCO, and a better authoring experience in Databricks Workflows.

SESSION SPEAKERS

Prashanth Babu Velanati Venkata

/Product Specialist
Databricks