In a previous post we saw that Polars has fast-track algorithms for calculating some statistics on sorted data. In this post we see that Polars also has a fast-track algorithm for getting groupby k...
To go big you must be lazy
I was consulting for a client recently who needs to process hundreds of Gb of CSV files. On their first pass with Polars they had read from their CSVs with a pattern like this (simplified) version....
AWS Lambda with Polars II: PyArrow
In a recent post I showed how to use Polars in AWS Lambda using the smart_open library. There are a variety of ways that you can work with Polars in AWS Lambda, however. In this post we look at how...
Quickstart with Polars
This post was created while writing my Up & Running with Polars course. Check it out on Udemy with a half price discount Want to jump right into using Polars? I’ve released a quickstart ...
Inspecting a Polars query
This post was created while writing my Up & Running with Polars course. Check it out here with a free preview of the first chapters A great feature of Polars is its query optimiser that c...
Profiling a Polars query
This post was created while writing my Up & Running with Polars course. Check it out here with a free preview of the first chapters You can’t optimise your code if you don’t know where th...
ML pre-processing with Polars
This post was created while writing my Up & Running with Polars course. Check it out here with a free preview of the first chapters I think we’ll see a nice ML pre-processing library deve...
Data science 2025
I started using Polars and DuckDB in late 2021. It was immediately apparent to me that these libraries would soon be at the heart of the of data science ecosystem. Since then the popularity of the ...
Polars 🤝 Matplotlib
This post was created while writing my Up & Running with Polars course. Check it out here with a free preview of the first chapters Polars gets on well with matplotlib. To make a bar cha...
Polars & Huggingface datasets
This post was created while writing my Up & Running with Polars course. Check it out here with a free preview of the first chapters One consequence of the Apache Arrow era is that differe...