Adobe Experience Platform (AEP) serves a large number Adobe digital experience customers with tens of thousands of datasets in non-Delta format. To leverage Delta Lake, we migrate existing tables to Delta format after resolving the following challenges:

• Short downtime to minimize customer impact


• Adding new system metadata


• Migration automation for scalability


• Error detection and catastrophic rollback

This session will cover the solutions to the above challenges and lessons learned from migration. Finally, we'll discuss how scalable migration service becomes a core capability of the data platform.