Accelerating the Future of Mobility: Unlock Real-Time Data Streaming for Connected Vehicle Platform

Connected vehicle data is utilized in various services that benefit society, such as disaster response and road condition monitoring. However, processing connected data through high-speed streaming while ensuring privacy and governance is not straightforward, due to the inherent characteristics of connected data and the need to handle PB-scale volumes.

Toyota similarly found that its existing architecture, which utilized Snowflake and AWS services, could not meet all its requirements. By adopting Lakeflow Spark Declarative Pipeline with Liquid Clustering, they were able to solve this challenge, achieving a 25% performance improvement and 24% cost reduction compared to the existing service.

We will share the results of this trial and present our future outlook toward autonomous driving and zero accidents, enabled by these achievements.