Iceberg as the Modern Table Standard at Apple
Overview
Experience | In Person |
---|---|
Type | Lightning Talk |
Track | Data Lakehouse Architecture and Implementation |
Industry | Enterprise Technology |
Technologies | Apache Spark, Apache Iceberg |
Skill Level | Advanced |
Duration | 20 min |
This session will explore Apache Iceberg as a modern table format that has revolutionized data storage and processing. We’ll dive into its core benefits, such as schema evolution, hidden partitioning and time-travel capabilities, and share how Apple leverages these features to optimize internal workflows.
The session will highlight Iceberg’s interoperability across compute engines commonly used at Apple: Spark, Trino and Flink, as well as its integration with streaming platforms like Kafka where it supports large scale batch and streaming workloads. Finally, we’ll discuss the emerging support for AWS-managed Iceberg metadata, and how this can greatly improve large-scale data workflows, paving the way for future advancements.
Session Speakers
Nicholas Mehr
/Software Engineer
Apple