홈페이지Data + AI Summit 2022 로고
Watch on demand

Polars: Blazingly Fast DataFrames in Rust and Python

On Demand

Type

  • Session

Format

  • Virtual

Track

  • 데이터 엔지니어링

Difficulty

  • Intermediate

Duration

  • 0 min
Download session slides

개요

This talk will introduce Polars a blazingly fast DataFrame library written in Rust on top of Apache Arrow. Its a DataFrame library that brings exploratory data analysis closer to the lessons learned in database research.

CPU's today's come with many cores and with their superscalar designs and SIMD registers allow for even more parallelism. Polars is written from the ground up to fully utilize the CPU's of this generation.

Besides blazingly fast algorithms, cache efficient memory layout and multi-threading, it consist of a lazy query engine, allowing Polars to do several optimizations that may improve query time and memory usage.

Read more:

https://github.com/pola-rs/polars https://www.ritchievink.com/blog/2021/02/28/i-wrote-one-of-the-fastest-dataframe-libraries/

Join the talk to learn more.

Session Speakers

Headshot of Ritchie Vink

Ritchie Vink

Polars: Blazingly fast DataFrames

Xomnia BV

Data+AI Summit 하이라이트 보기

Watch on demand