When we started Databricks, we thought that extracting insights from big data was insanely difficult for no good reason. You almost needed an…

Databricks now includes a new feature called Jobs, enabling support for running production pipelines, consisting of standalone Spark applications. Jobs includes a scheduler…