Voice from CERN: Apache Spark 2.0 Performance Improvements Investigated With Flame Graphs
This is a guest post from CERN, the European Organization for Nuclear Research. In this blog, Luca Canali of CERN investigates performance improvements...
How to Evaluate a Cloud-based Apache Spark Platform
As the most active open source project in big data, Apache Spark is taking the world by storm. This rise to prominence coupled...
Apache Spark Survey 2016 Results Now Available
In July 2016, we conducted our Apache Spark Survey to identify insights on how organizations are using Spark and highlight growth trends since...
Apache Spark Earns Datanami Awards for Machine Learning, Real-time Analytics, and More
Today, the Datanami Readers’ and Editors’ Choice Awards recognized the sweeping changes Apache Spark is bringing to the Big Data landscape with four...
Writing Data Engineering Pipelines in Apache Spark on Databricks
Try this notebook in Databricks This is part 3 of a 3 part series providing a gentle introduction to writing Apache Spark applications...
Apache Spark @Scale: A 60 TB+ production use case from Facebook
This is a guest Apache Spark community blog from Facebook Engineering . In this technical blog, Facebook shares their usage of Apache Spark...
Notebook Workflows: The Easiest Way to Implement Apache Spark Pipelines
[glossary_parse]Today we are excited to announce Notebook Workflows in Databricks. Notebook Workflows is a set of APIs that allow users to chain notebooks...
On-demand webinar available: Databricks’ Data Pipeline
Two weeks ago we held a live webinar – Databricks' Data Pipeline: Journey and Lessons Learned – to show how Databricks used Apache...
The Quest for Hidden Treasure: An Apache Spark Connector for the Riak NoSQL database
View this notebook in Databricks This is a guest blog from our friends at Basho. Pavel Hardak is a director of product management...
Agenda Announced for #SparkSummit Europe 2016 in Brussels
Brussels, the de facto capital of the European Union, has its draw not only to politicians and tourists but technologists and entrepreneurs. So...