Analysing Metro Operations Using Apache Spark on Databricks
This is a guest blog from EY Advisory Data & Analytics team, who have been working with Sporveien in Oslo building a platform...
Five Spark SQL Utility Functions to Extract and Explore Complex Data Types
Try this notebook on Databricks For developers, often the how is as important as the why . While our in-depth blog explains the...
10th Spark Summit Sets Another Record of Attendance
We have assembled a selected collage of highlights from Databricks’ speakers at our 10th Spark Summit, a milestone for Apache Spark community and...
Databricks Serverless: Next Generation Resource Management for Apache Spark
As the amount of data in an organization grows, more and more engineers, analysts and data scientists need to analyze this data using...
A Vision for Making Deep Learning Simple
Try this notebook on Databricks When MapReduce was introduced 15 years ago, it showed the world a glimpse into the future. For the...
Making Apache Spark the Fastest Open Source Streaming Engine
We started building Structured Streaming in Apache Spark one year ago as a new, simpler way to develop continuous applications . Not only...
Sharing Knowledge with the Community in a Preview of Apache Spark: The Definitive Guide
Apache Spark has seen immense growth over the past several years. The size and scale of this Spark Summit is a true reflection...
Integrating Apache Spark with Cucumber for Behavioral-Driven Development
This is a guest blog from FIS Global One of the most difficult scenarios in data processing is ensuring that the data is...
It's Almost Time for Spark Summit 2017 in San Francisco
Get ready! In less than two weeks, thousands of developers, data scientists, analysts, researchers and business executives from around the world will gather...
Apache Spark Cluster Monitoring with Databricks and Datadog
This blog post is a joint effort between Caryl Yuhas, Databricks’ Solutions Architect, and Ilan Rabinovitch, Datadog’s Director of Technical Community and Evangelism...