Cost Management for Serverless Compute: Notebooks, Jobs, and Pipelines

Serverless compute removes infrastructure overhead, but platform teams still need to govern who can use it and how much each workload can spend. This session covers the cost-control model now for serverless Notebooks, Jobs, and Lakeflow Pipelines, current features, recent developments, and the roadmap ahead.We walk through the new primitives: entitlements that grant or revoke serverless access per user, group, or service principal, and per-workload rate limits that cap the spend rate of an individual Job or Pipeline. Attendees leave with a concrete migration path from cluster policies to serverless cost controls.