Skip to main content

Developing Applications with Apache Spark™ - Mandarin Chinese

在本课程中掌握使用 Apache Spark 进行可扩展数据处理的技能。学习构建高效的 ETL 管道、执行高级分析,并使用 Spark 的 DataFrame API 优化分布式数据转换。浏览分组、聚合、连接、集合运算和窗口函数。在应用性能优化最佳实践的同时,处理数组、映射和结构体等复杂数据类型。


注意:对于 SCORM 讲座文件,请确保在完成内容后关闭 SCORM 窗口。请勿点击‘Next Lesson’按钮,否则 SCORM 模块可能无法标记为已完成。


Skill Level
Associate
Duration
3h
Prerequisites

本课程的内容面向具备以下技能、知识和能力的学员:

• 基本编程知识

• 熟悉 Python

• 对 SQL 查询的基本了解(SELECT、JOIN、GROUP BY)

• 熟悉数据处理概念

• 需要完成"Apache Spark 入门课程"或具备 Databricks 使用经验 

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

See all our registration options

Registration options

Databricks has a delivery method for wherever you are on your learning journey

Runtime

Self-Paced

Custom-fit learning paths for data, analytics, and AI roles and career paths through on-demand videos

Register now

Instructors

Instructor-Led

Public and private courses taught by expert instructors across half-day to two-day courses

Register now

Learning

Blended Learning

Self-paced and weekly instructor-led sessions for every style of learner to optimize course completion and knowledge retention. Go to Subscriptions Catalog tab to purchase

Purchase now

Scale

Skills@Scale

Comprehensive training offering for large scale customers that includes learning elements for every style of learning. Inquire with your account executive for details

Upcoming Public Classes

Model Development at Scale

In this course, you will learn to design and implement machine learning workflows that scale from a single machine to distributed compute on Databricks. The curriculum is organized into three modules: foundations of model development (when and why to distribute, and how Spark executes work), scalable model development with Spark ML and MLflow, and distributed model training with Ray and PyTorch — closing with a framework for choosing the right tool for a given workload.

Through hands-on demos and labs, you will build distributed Spark ML pipelines using Transformers, Estimators, and the fit/transform paradigm; scale existing pandas code with the Pandas API on Spark; and track, compare, and govern experiments with MLflow 3 and Unity Catalog. You will then train models across a cluster with Ray Train and PyTorch (TorchDistributor and DeepSpeed), and learn to match each workload to the right framework based on data size, model size, hardware, and cost.

The course concludes with a capstone that takes a problem end to end — engineering features, training a model at scale, tracking it with MLflow, and registering it in Unity Catalog with a governance alias. (Production deployment, serving, and monitoring are covered in the separate Advanced MLOps course.)

By the end, you will be able to choose, build, and justify distributed, reproducible, and governed model-development workflows on Databricks.

Note: For SCORM lecture files, please ensure that you close the SCORM window after completing the content. Do not click the ‘Next Lesson’ button, as doing so may prevent the SCORM module from being marked as complete.

Paid & Subscription
4h
Lab
Professional

Questions?

If you have any questions, please refer to our Frequently Asked Questions page.