Skip to main content

Databricks Performance Optimization - Mandarin Chinese

Databricks Performance Optimization 课程教导数据工程师和分析师如何在 Databricks Data Intelligence Platform 上诊断、衡量和修复性能瓶颈,以及如何将性能提升与成本关联起来。本课程遵循"先衡量、先平台"的工作流:让平台的自动优化功能承担繁重工作,通过 Query Profile 和系统表验证已应用的优化,再在必要时进行手动调优。


学员将以 Query Profile、Performance Insights 和查询历史记录系统表为基础,学习如何衡量性能。在此基础上,他们将探索关键优化技术,包括数据布局与自调优托管表、liquid clustering、缓存与中间结果、shuffle、数据倾斜、溢出、行爆炸、驱动程序性能、Python UDF、serverless compute、Photon 以及成本归因。


在整个课程中,学员将针对合成零售数据中刻意设计的慢查询进行探索,观察不同优化技术对性能的影响。他们将利用文件裁剪、任务执行时间、Photon 覆盖率和成本等依据来评估优化效果。两个基于场景的实验室将强化从诊断到验证的完整优化工作流。


注意:Databricks Academy 正在将 Databricks 环境中的课堂课程转为基于 notebook 的形式,并停止在讲座中使用幻灯片。您可以在 Vocareum 实验环境中访问课程 notebook。

Skill Level
Professional
Duration
3h
Prerequisites

本课程的内容是为具备以下技能、知识和能力的学员开发的:

• 导航 Databricks workspace 并运行笔记本

• 编写中级 SQL,包括连接和聚合

• 使用 DataFrame 转换和操作编写 PySpark

• 使用 Delta Lake 表及 Unity Catalog 的核心概念,包括目录、架构、表和托管表

• 理解 Spark 执行的核心概念,包括分区、转换和惰性求值

• 基本了解 Lakeflow Jobs,包括调度和将笔记本工作负载作为作业运行

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Data Engineer

Databricks Performance Optimization

Databricks Performance Optimization teaches data engineers and analysts how to diagnose, measure, and fix performance bottlenecks on the Databricks Data Intelligence Platform, and how to tie performance improvements back to cost. The course follows a measurement-first, platform-first workflow: let the platform's automatic optimizations do the heavy lifting, verify what was applied using Query Profile and system tables, then manually tune where needed.

Learners build a foundation for measuring performance with Query Profile, Performance Insights, and query history system tables. From there, they explore key optimization techniques, including data layout and self-tuning managed tables, liquid clustering, caching and intermediate results, shuffle, skew, spill, row explosions, driver performance, Python UDFs, serverless compute, Photon, and cost attribution.

Throughout the course, learners explore deliberately slow queries over synthetic retail data and see how different optimization techniques affect performance. They use evidence such as file pruning, task execution time, Photon coverage, and cost to evaluate improvements. Two scenario-based labs reinforce the optimization workflow from diagnosis through validation.

Note: For SCORM lecture files, please ensure that you close the SCORM window after completing the content. Do not click the ‘Next Lesson’ button, as doing so may prevent the SCORM module from being marked as complete.

Paid & Subscription
3h
Lab
Professional

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.