Platform blog

Streamline MLOps With MLflow Model Registry Webhooks

Ahmed Bilal
Corey Zumar
Arpit Jasapara
Ankit Mathur
Sue Ann Hong
Share this post

As machine learning becomes more widely adopted, businesses need to deploy models at speed and scale to achieve maximum value. Today, we are announcing MLflow Model Registry Webhooks, making it easier to automate your model lifecycle by integrating it with the CI/CD platforms of your choice.

Model Registry Webhooks enable you to register callbacks that are triggered by Model Registry events, such as creating a new model version, adding a new comment, or transitioning the model stage. You can use these callbacks to invoke automation scripts to implement MLOps on Databricks. For example, you can trigger CI builds when a new model version is created or notify your team members through Slack each time a model transition to production is requested. By automating your ML workflow, you can improve developer productivity, accelerate model deployment and create more value for your end-users and organization.

MLflow Model Registry Webhooks are now available in public preview for all Databricks customers.
Databricks Model Registry Webhooks enable you to invoke automation scripts to implement MLOps on Databricks.

Webhooks simplify integrations with MLflow Model Registry

The MLflow Model Registry provides a central repository to manage the model deployment lifecycle. Today, ML teams manually manage their models in Model Registry. However, as teams grow and cover more ML use cases, the number of models continues to increase, making it inefficient and impractical to operate these models manually. Many teams automate the model deployment lifecycle by building an ad-hoc service that frequently polls the Model Registry to look for changes. Model Registry Webhooks simplify this automation by sending real-time notifications when events happen in Model Registry. Webhooks can be configured to trigger a workflow in a CI/CD platform or a pre-defined Databricks job

MLOps use cases with Webhooks

With webhooks, you can automate your machine learning workflow by setting up integrations with the MLflow Model Registry. For example, you can use webhooks to perform the following integrations:

  • Trigger a CI workflow to validate your model when a new version of the model is created
  • Notify your team of the pending request through a messaging app when a model has received a stage transition request
  • Invoke a workflow to evaluate model fairness and bias when a model transition to production is requested
  • Trigger a deployment pipeline to automatically deploy your model when a tag is created.

By automating your model deployment lifecycle, you can improve model quality, reduce rework, and ensure that each ML team member focuses on what they do best. Some of the most advanced users of the MLflow Model Registry are already using webhooks to manage millions of ML models.

Get started with the MLflow Model Registry Webhooks

Ready to get started or try it out for yourself? You can read more about MLflow Model Registry Webhooks and how to use them in our documentation at AWS, Azure, and GCP.

Try Databricks for free

Related posts

Company blog

Introducing the MLflow Model Registry

October 17, 2019 by Clemens Mewald and Matei Zaharia in Company Blog
Watch the announcement and demo At today’s Spark + AI Summit in Amsterdam, we announced the availability of the MLflow Model Registry, a n...
Company blog

Databricks Extends MLflow Model Registry with Enterprise Features

We are excited to announce new enterprise grade features for the MLflow Model Registry on Databricks. The Model Registry is now enabled by...
Engineering blog

MLflow Model Registry on Databricks Simplifies MLOps With CI/CD Features

MLflow helps organizations manage the ML lifecycle through the ability to track experiment metrics, parameters, and artifacts, as well as deploy models to...
See all Platform Blog posts