Enhanced Hyperparameter Tuning and Optimized AWS Storage with Databricks Runtime 5.4 ML
We are excited to announce the release of Databricks Runtime 5.4 ML ( Azure | AWS ). This release includes two Public Preview...
Introducing Databricks Runtime 5.4 with Conda (Beta)
We are excited to introduce a new runtime: Databricks Runtime 5.4 with Conda (Beta). This runtime uses Conda to manage Python libraries and...
Advanced Analytics with HyperLogLog Functions in Apache Spark
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Efficient Databricks Deployment Automation with Terraform
Managing cloud infrastructure and provisioning resources can be a headache that DevOps engineers are all too familiar with. Even the most capable cloud...
Announcing General Availability of Managed MLflow on Databricks
Try this tutorial in Databricks MLflow is an open source platform to help manage the complete machine learning lifecycle. With MLflow, data scientists...
Koalas: Easy Transition from pandas to Apache Spark
Today at Spark + AI Summit, we announced Koalas, a new open source project that augments PySpark’s DataFrame API to make it compatible...
Managing the Complete Machine Learning Lifecycle: On-Demand Webinar now available!
On March 7th, our team hosted a live webinar— Managing the Complete Machine Learning Lifecycle —with Andy Konwinski, Co-Founder and VP of Product...
Databricks Runtime 5.3 ML Now Generally Available
We are excited to announce the general availability (GA) of Databricks Runtime for Machine Learning, as part of the release of Databricks Runtime...
Introducing Brickchain: Planet-scale Unified Analytics
Today we are excited to announce Brickchain , the next generation technology for zettabyte-scale analytics, by harnessing all the compute power on the...
Managed MLflow on Databricks now in public preview
Try this tutorial in Databricks Building production machine learning applications is challenging because there is no standard way to record experiments, ensure reproducible...