Skip to main content

Agent Evaluation on Databricks - Mandarin Chinese

本课程教授学生如何使用 MLflow 的评估框架对 AI 智能体进行系统性评估,以应对传统软件测试无法处理的非确定性 AI 系统所带来的独特挑战。学生将评估一个已注册在 Unity Catalog 中并通过 Unity Gateway 调用其模型的共享工具调用智能体,使用内置评判器处理正确性和安全性等常见标准,使用准则评判器满足特定业务需求,并使用自定义评判器应对专项需求。本课程涵盖使用精选数据集进行离线评估和在线生产监控,包括在 Unity Catalog 中存储 MLflow Traces。学生将使用 MLflow Tracing 了解智能体的执行模式,并收集来自开发人员和主题专家的人工反馈,这些专家通过 Databricks App 对智能体进行审查。通过实践演示和实验,学生将掌握创建评估 Workflows 的技能,从而在 AI 智能体开发生命周期中持续推动质量提升。


注意:对于 SCORM 讲授文件,请确保在完成内容后关闭 SCORM 窗口。请勿点击“Next Lesson”按钮,否则可能导致 SCORM 模块无法被标记为已完成。

Skill Level
Associate
Duration
2h
Prerequisites

本课程的内容是针对具备以下技能、知识和能力的学员设计的:

• 具备中级 Python 编程经验

• 具备基本 SQL 知识,能够进行查询和创建函数

• 熟悉 Databricks Data Intelligence Platform

• 了解 Unity Catalog 概念,包括目录和架构

• 基本了解大型语言模型(LLMs)及提示工程

• 具备 MLflow 基础知识

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Catalog Management and Data Organization

In this course, you will learn how to design, implement, and govern catalog structures and large-scale data organization on the Databricks Data Intelligence Platform. It offers a comprehensive view of Unity Catalog as the centralized governance layer for an enterprise lakehouse. Divided into five modules, it begins by placing Unity Catalog within the cloud deployment model — covering the Account Console, metastore creation, and the administrator role hierarchy. You will then translate organizational topology (business units, regions, and dev/QA/prod environments) into a scalable catalog and schema design using naming conventions, ownership patterns, and MANAGE delegation. The course then covers secure storage integration with storage credentials, external locations, the managed-storage hierarchy, managed versus external tables, and UC Volumes for non-tabular data. Next, you will apply access patterns and isolation strategies — the three-level GRANT chain, workspace-catalog binding, and schema-level Attribute-Based Access Control (ABAC) policies — to enforce fine-grained data protection at scale. Finally, the course closes with best practices for catalog design, automation, least-privilege permissions, and group-based access management.

Note: For SCORM lecture files, please ensure that you close the SCORM window after completing the content. Do not click the ‘Next Lesson’ button, as doing so may prevent the SCORM module from being marked as complete.

Free
2h
Associate

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.