Introducing Cluster-scoped Init Scripts
This summer, I worked at Databricks as a software engineering intern on the Clusters team. As part of my internship project, I designed...
By Customer Demand: Databricks and Snowflake Integration
Today, we are proud to announce a partnership between Snowflake and Databricks that will help our customers further unify Big Data and AI...
5 Reasons to Attend Spark + AI Summit Europe 2018
The world’s largest event for the Apache Spark Community By Singh Garewal Posted in COMPANY BLOG August 27, 2018 Spark + AI Summit...
Announcing Databricks Runtime 4.3
I'm pleased to announce the release of Databricks Runtime 4.3, powered by Apache Spark. We've packed this release with an assortment of new...
How to Use MLflow to Experiment a Keras Network Model: Binary Classification for Movie Reviews
In the last blog post , we demonstrated the ease with which you can get started with MLflow , an open-source platform to...
New Features in MLflow v0.5.2 Release
Today, we’re excited to announce MLflow v0.5.0, MLflow v0.5.1, and MLflow v0.5.2, which were released last week with some new features. MLflow 0.5.2...
Introducing mlflow-apps: A Repository of Sample Applications for MLflow
Introduction This summer, I was a software engineering intern at Databricks on the Machine Learning (ML) Platform team. As part of my intern...
100x Faster Bridge between Apache Spark and R with User-Defined Functions on Databricks
SparkR User-Defined Function (UDF) API opens up opportunities for big data workloads running on Apache Spark to embrace R's rich package ecosystem. Some...
Building a Real-Time Attribution Pipeline with Databricks Delta
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. In digital advertising, one...
Loan Risk Analysis with XGBoost and Databricks Runtime for Machine Learning
Try this notebook series in Databricks For companies that make money off of interest on loans held by their customer, it’s always about...