Optimizing Order Picking to Increase Omnichannel Profitability with Databricks
Check our new Order Picking Optimization Solution Accelerator for more details and to download the notebooks. Demand for buy-online pickup in-store (BOPIS), curbside…
Engineering Blog
Parallel ML: How Compass Built a Framework for Training Many Machine Learning Models on Databricks
This is a collaborative post from Databricks and Compass. We thank Sujoy Dutta, Senior Machine Learning Engineer at Compass, for his contributions. …
Hunting for IOCs Without Knowing Table Names or Field Labels
There is a breach! You are an infosec incident responder and you get called in to investigate. You show up and start asking…
Introducing Spark Connect – The Power of Apache Spark, Everywhere
At last week’s Data and AI Summit, we highlighted a new project called Spark Connect in the opening keynote. This blog post walks…
Designing a Java Connector for Delta Sharing Recipient
Making an open data marketplace Stepping into this brave new digital world we are certain that data will be a central product for…
Introducing MLflow Pipelines with MLflow 2.0
Since we launched MLflow in 2018, MLflow has become the most popular MLOps framework, with over 11M monthly downloads! Today, teams of all…
Connect From Anywhere to Databricks SQL
Today we are thrilled to announce a full lineup of open source connectors for Go, Node.js, Python, as well as a new CLI…
Project Lightspeed: Faster and Simpler Stream Processing With Apache Spark
Streaming data is a critical area of computing today. It is the basis for making quick decisions on the enormous amounts of incoming…
Automating PHI Removal from Healthcare Data With Natural Language Processing
Minimum necessary standard and PHI in healthcare research Under the Health Insurance Portability and Accountability Act (HIPAA), minimum necessary standard, HIPAA-covered entities (such…
Architecting MLOps on the Lakehouse
Here at Databricks, we have helped thousands of customers put Machine Learning (ML) into production. Shell has over 160 active AI projects saving…
