Skip to main content

Generative AI Application Deployment and Monitoring

Ready to learn how to deploy, operationalize, and monitor generative AI applications? This content will help you gain skills in the deployment of generative AI applications using tools like Model Serving. We’ll also cover how to operationalize generative AI applications following best practices and recommended architectures. Finally, we’ll discuss the idea of monitoring generative AI applications and their components using Lakehouse Monitoring.


Languages Available: English | 日本語 | Português BR | 한국어

Skill Level
Associate
Duration
4h
Prerequisites
  • Familiarity with natural language processing concepts
  • Familiarity with prompt engineering/prompt engineering best practices 
  • Familiarity with the Databricks Data Intelligence Platform
  • Familiarity with RAG  (preparing data, building a RAG architecture, concepts like embedding, vectors, vector databases, etc.)
  • Experience with building LLM applications using multi-stage reasoning LLM chains and agents
  • Familarity with Databricks Data Intelligence Platform tools for evaluation and governance. 



Outline

Model Deployment Fundamentals

  • Model Management
  • Deployment Methods


Batch Deployment

  • Introduction to Batch Deployment
  • Batch Inference
  • Batch Inference Workflows using SLM


Real-Time Deployment

  • Introduction to Real-Time Deployment
  • Databricks Model Serving
  • Serving External Models with Model Serving
  • Deploying an LLM Chain to Databricks Model Serving 
  • Custom Model Deployment and A/B Testing


AI System Monitoring

  • AI Application Monitoring
  • Online Monitoring an LLM RAG Chain


LLMOps Concepts

  • MLOps Primer
  • LLMOps vs MLOps

Upcoming Public Classes

Date
Time
Language
Price
Jul 21
01 PM - 05 PM (Asia/Kolkata)
English
$750.00
Jul 29
09 AM - 01 PM (Europe/London)
English
$750.00
Jul 30
09 AM - 01 PM (America/New_York)
English
$750.00
Aug 11
09 AM - 01 PM (Europe/London)
English
$750.00
Aug 14
09 AM - 01 PM (America/New_York)
English
$750.00
Sep 08
09 AM - 01 PM (America/New_York)
English
$750.00
Sep 10
09 AM - 01 PM (Europe/London)
English
$750.00
Sep 12
09 AM - 01 PM (Asia/Kolkata)
English
$750.00

Public Class Registration

If your company has purchased success credits or has a learning subscription, please fill out the Training Request form. Otherwise, you can register below.

Private Class Request

If your company is interested in private training, please submit a request.

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Data Analyst

Data Analysis with Databricks

This course provides a comprehensive introduction to Databricks SQL. Learners will ingest data, write queries, produce visualizations and dashboards, and configure alerts. This course will prepare you to take the Databricks Certified Data Analyst Associate exam.

This course consists of two four-hour modules. 

SQL Analytics on Databricks

In this course, you'll learn how to effectively use Databricks for data analytics, with a specific focus on Databricks SQL. As a Databricks Data Analyst, your responsibilities will include finding relevant data, analyzing it for potential applications, and transforming it into formats that provide valuable business insights. 

You will also understand your role in managing data objects and how to manipulate them within the Databricks Data Intelligence Platform, using tools such as Notebooks, the SQL Editor, and Databricks SQL. 

Additionally, you will learn about the importance of Unity Catalog in managing data assets and the overall platform. Finally, the course will provide an overview of how Databricks facilitates performance optimization and teach you how to access Query Insights to understand the processes occurring behind the scenes when executing SQL analytics on Databricks.

AI/BI for Data Analysts

In this course, you’ll learn how to use the features Databricks provides for business intelligence needs: AI/BI Dashboards and AI/BI Genie. As a Databricks Data Analyst, you will be tasked with creating AI/BI Dashboards and AI/BI Genie Spaces within the platform, managing the access to these assets by stakeholders and necessary parties, and maintaining these assets as they are edited, refreshed, or decommissioned over the course of their lifespan. This course intends to instruct participants on how to design dashboards for business insights, share those with collaborators and stakeholders, and maintain those assets within the platform. Participants will also learn how to utilize AI/BI Genie Spaces to support self-service analytics through the creation and maintenance of these environments powered by the Databricks Data Intelligence Engine.

Languages Available: English | 日本語 | Português BR | 한국어
Paid
8h
Lab
instructor-led
Associate

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.