Apache Spark Now a Top-level Apache Project
We are delighted with the recent announcement of the Apache Software Foundation that Apache Spark has become a top-level Apache project. This is...
AMPLab updates the Big Data Benchmark
The AMPLab at UC Berkeley, with help from Databricks, recently released an update to the Big Data Benchmark . This benchmark uses Amazon...
Apache Spark 0.9.0 Released
Our goal with Apache Spark is very simple: provide the best platform for computation on big data. We do this through both a...
Apache Spark and Hadoop: Working Together
We are often asked how does Apache Spark fits in the Hadoop ecosystem , and how one can run Spark in a existing...
Apache Spark In MapReduce (SIMR)
Apache Hadoop integration has always been a key goal of Apache Spark and YARN users have long been able to run Spark on...