Many Model Forecasting in Real-Time With the Databricks Online Store

Forecasting is still one of the most important and yet hardest tasks to get right. When it comes to forecasting in real-time people may think it’s simply impossible as often forecasting means batch process that would be executed on a scheduled base. In this session, you will learn first how to fit hundreds of thousands of individual forecasts using Spark and Delta and how to monitor your forecasts with the new monitoring capabilities on the Databricks Data Intelligence platform. Next, we will present you with multiple scenarios of how to access your forecasting models and in-point-lookup data at the requested time by a user outside of Databricks. The main helpers will be the recently announced Feature and Function Serving from Databricks combined with the Model Serving and Feature Engineering with the Unity Catalog.