Session
How an Open, Scalable and Secure Data Platform is Powering Quick Commerce Swiggy's AI
Overview
Experience | In Person |
---|---|
Type | Breakout |
Track | Data Engineering and Streaming |
Industry | Retail and CPG - Food |
Technologies | Apache Spark, Delta Lake, Unity Catalog |
Skill Level | Intermediate |
Duration | 40 min |
Swiggy, India's leading quick commerce platform, serves ~13 million users across 653 cities, with 196,000 restaurant partners and 17,000 SKUs. To handle this scale, Swiggy developed a secure, scalable AI platform processing millions of predictions per second. The tech stack includes Apache Kafka for real-time streaming, Apache Spark on Databricks for analytics and ML, and Apache Flink for stream processing. The Lakehouse architecture on Delta ensures data reliability, while Unity Catalog enables centralized access control and auditing. These technologies power critical AI applications like demand forecasting, route optimization, personalized recommendations, predictive delivery SLAs, and generative AI use cases.Key Takeaway:This session explores building a data platform at scale, focusing on cost efficiency, simplicity, and speed, empowering Swiggy to seamlessly support millions of users and AI use cases.
Session Speakers
Vasan Vembu Srini
/Sr Solutions Architect
Databricks
Akash Agarwal
/Principal Engineer
Swiggy