Two weeks ago, we released Dolly , a large language model (LLM) trained for less than $30 to exhibit ChatGPT-like human interactivity (aka...

As enterprises grow their investments in data platforms, they increasingly want to go beyond using data for internal analytics and start integrating predictions...

Some brands start out as, well, brands. A lot of work goes into the concept and painting the picture before the business is...

To learn more about Apache Spark, attend Spark Summit East in New York in Feb 2016 . 2015 has been a year of...

To learn more about Apache Spark, attend Spark Summit East in New York in Feb 2016 . Today we are happy to announce...

Today we are happy to announce the availability of an Apache Spark 1.6 preview package in Databricks. The Apache Spark 1.6.0 release is...

We ran the Spark Survey 2015 this summer to gain insights on how organizations are using Apache Spark. The results of this year’s...

The inaugural Spark Summit Europe will be held in Amsterdam this October. Check out the full agenda and get your ticket before it...

With so many distributed stream processing engines available, people often ask us about the unique benefits of Apache Spark Streaming . From early...

This is a joint blog post with our partner Hortonworks. Zhan Zhang is a member of technical staff at Hortonworks, where he collaborated...

Today I’m excited to announce the general availability of Apache Spark 1.4! Spark 1.4 introduces SparkR, an R API targeted towards data scientists...

Today I’m excited to announce the general availability of Apache Spark 1.3! Apache Spark 1.3 introduces the widely anticipated DataFrame API, an evolution...

2014 has been a year of tremendous growth for Apache Spark. It became the most active open source project in the Big Data...

Today we are happy to announce that the complete Learning Spark book is available from O’Reilly in e-book form with the print copy...

Today, we are happy to announce Apache Spark Packages ( http://spark-packages.org ), a community package index to track the growing number of open source packages and libraries that work with Apache Spark. Spark Packages makes it easy for users to find, discuss, rate, and install packages for any version of Spark, and makes it easy for developers to contribute packages.

We at Databricks are thrilled to announce the release of Apache Spark 1.2! Apache Spark 1.2 introduces many new features along with scalability...

With Apache Spark 1.1 recently released, we’d like to take this occasion to feature one of the most popular Spark components - Spark...

Today we’re thrilled to announce the release of Apache Spark 1.1! Apache Spark 1.1 introduces many new features along with scale and stability improvements. This post will introduce some key features of Apache Spark 1.1 and provide context on the priorities of Spark for this and the next release.

Today, we’re very proud to announce the release of Apache Spark 1.0 . Apache Spark 1.0 is a major milestone for the Spark...

Our goal with Apache Spark is very simple: provide the best platform for computation on big data. We do this through both a...

We are happy to announce the release of Apache Spark 0.8.1. In addition to performance and stability improvements, this release adds three new...