Session
Spark Connect: Flexible, Local Access to Apache Spark at Scale
Overview
| Experience | In Person |
|---|---|
| Type | Breakout |
| Track | Data Engineering and Streaming |
| Industry | Enterprise Technology |
| Technologies | Apache Spark |
| Skill Level | Intermediate |
| Duration | 40 min |
What if you could run Spark jobs without worrying about clusters, versions and upgrades? Did you know Spark has this functionality built-in today? Join us to take a look at this functionality — Spark Connect.
Join us to dig into how Spark Connect works — abstracting away Spark clusters away in favor of the DataFrame API and unresolved logical plans.
You will learn some of the cool things Spark Connect unlocks, including:
- Moving you from thinking about clusters to just thinking about jobs
- Making Spark code more portable and platform agnostic
- Enabling support for languages such as Go
Session Speakers
James Malone
/Product Manager
Databricks