Skip to main content
Company Blog

At today’s Spark Summit, Databricks and IBM announced a joint effort to contribute key machine learning capabilities to the Apache Spark Project.  Over the course of the next few months, Databricks and IBM will collaborate to expand Spark’s machine learning capabilities. The companies plan to introduce new domain specific algorithms to the Spark ecosystem and add new machine learning primitives in the Apache Spark Project. IBM and Databricks will also collaborate to integrate IBM’s SystemML – a robust machine-learning engine for large-scale data, with the Spark platform.

“The size and scale of companies that are partnering with Databricks to support the Spark movement is both inspiring and validating,” said Ion Stoica, CEO at Databricks. “We are looking forward to IBM becoming a key member of the Spark community, as seen by their investment in a Spark Technology Center in San Francisco. This collaboration will help Spark continue to gain mainstream adoption and deliver next-generation big data analytics and applications.”

Press release: Databricks and IBM Collaborate to Advance Machine Learning to the Apache Spark Project


Learn More

For Spark enthusiasts abroad, the first Spark Summit Europe will be in Amsterdam from October 27th to 29th. Submit a presentation by June 23 and register now to get a discount.

To keep up with Spark and Databricks news, don’t forget to sign up for our monthly newsletter.



Try Databricks for free

Related posts

Platform blog

Simplify Advertising Analytics Click Prediction with Databricks Unified Analytics Platform

July 19, 2018 by Tony Cruz and Denny Lee in Product
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Industries category icon 1

How to Build a Credit Data Platform on the Databricks Lakehouse

Get started and build a credit data platform for your business by visiting the demo at Databricks Demo Center. Introduction According to the...
Data AI

Riding the AI Wave

March 15, 2022 by Danny Healy in Data Strategy
“...incorporating machine learning into a company’s application development is difficult…” It’s been almost a decade since Marc Andreesen hailed that software was eating the world...
See all Company Blog posts