How to Evaluate a Cloud-based Apache Spark Platform
As the most active open source project in big data, Apache Spark is taking the world by storm. This rise to prominence coupled...
Apache Spark Survey 2016 Results Now Available
In July 2016, we conducted our Apache Spark Survey to identify insights on how organizations are using Spark and highlight growth trends since...
Apache Spark Earns Datanami Awards for Machine Learning, Real-time Analytics, and More
Today, the Datanami Readers’ and Editors’ Choice Awards recognized the sweeping changes Apache Spark is bringing to the Big Data landscape with four...
Writing Data Engineering Pipelines in Apache Spark on Databricks
Try this notebook in Databricks This is part 3 of a 3 part series providing a gentle introduction to writing Apache Spark applications...
Notebook Workflows: The Easiest Way to Implement Apache Spark Pipelines
[glossary_parse]Today we are excited to announce Notebook Workflows in Databricks. Notebook Workflows is a set of APIs that allow users to chain notebooks...