Shark, Spark SQL, Hive on Spark, and the future of SQL on Apache Spark
With the introduction of Spark SQL and the new Hive on Apache Spark effort ( HIVE-7292 ), we get asked a lot about...
Exciting Performance Improvements on the Horizon for Spark SQL
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Announcing Apache Spark 1.0
Today, we’re very proud to announce the release of Apache Spark 1.0 . Apache Spark 1.0 is a major milestone for the Spark...
Making Apache Spark Easier to Use in Java with Java 8
One of Apache Spark’s main goals is to make big data applications easier to write. Spark has always had concise APIs in Scala...
Apache Spark 0.9.1 Released
We are happy to announce the availability of Apache Spark 0.9.1 ! This is a maintenance release with bug fixes, performance improvements, better...
Spark SQL: Manipulating Structured Data Using Apache Spark
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Apache Spark: A Delight for Developers
This article was cross-posted in the Cloudera developer blog . Apache Spark is well known today for its performance benefits over MapReduce...
Apache Spark Now a Top-level Apache Project
We are delighted with the recent announcement of the Apache Software Foundation that Apache Spark has become a top-level Apache project. This is...
AMPLab updates the Big Data Benchmark
The AMPLab at UC Berkeley, with help from Databricks, recently released an update to the Big Data Benchmark . This benchmark uses Amazon...
Apache Spark 0.9.0 Released
Our goal with Apache Spark is very simple: provide the best platform for computation on big data. We do this through both a...