Hacker News·5 min read·hard

Pre-Release of Polars 2.0

K
komape
AI Summary

The Polars data processing library has released a release candidate for version 2.0, which introduces significant performance improvements by defaulting to a streaming engine. This update aims to optimize memory usage and speed, though it changes default behaviors regarding row-order consistency.

Why it matters

As a popular tool for data science, these changes will impact the performance and code structure of data pipelines for developers worldwide.

Dive DeeperCreate a free account to unlock

Today we are releasing the first release candidate for Polars 2.0. The definite 2.0 release will land in the following weeks. We don’t aim to make a big feature release of Polars 2.0. In fact we hope it to be a boring experience for you. The reason we bump this major version is that we can get rid of design decisions made in the past that currently block us and then we want to change defaults to more sensible settings that will benefit a greater audience. The biggest default change will be that all LazyFrame queries now will run on the streaming engine. Casual Polars users can therefore expect huge improvements in memory usage and performance. In aggregate we expect the streaming engine to be easily 5x faster .

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
technologybusiness

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in