A curated list of Polars docs, talks, tools, examples & articles the internet has to offer.
Polars is a lightning-fast DataFrame library for Rust, Python, Node.js and R.
Implemented in Rust, Polars uses Apache Arrow Columnar Format as the memory model.
Contributions of any kind welcome!
Just follow the guidelines by either:
- Filling a suggestion issue (easier).
- Opening a pull request.
To see the latest entries in the list : click here !
Awesome Polars
Official documentation
- Documentation - Official user guide for Python, Rust and R.
- Documentation for Python API - Official API Reference for Python.
- Documentation for Rust API - Official API Reference for Rust.
- Documentation for Node.js API - Official API Reference for Node.js.
- Documentation for R API - Official API Reference for R (WIP).
- Github: Polars Github Organization - Official Polars Github repository.
- Blog posts from Polars - Official blogs posts from Polars.
- Keynote on Polars at EuroSciPy 2023 ⏳
57 min
- Talk by @ritchie46 that dives into Polars and sees what makes it so efficient. It will touch on technologies like Arrow, Rust, parallelism, data structures, query optimization and more.
NEWS (August 2023): Polars announces that it has raised a a $4M seed round!
Libraries/Packages/Scripts
Python
- polars for Python - Python
polars
package to use polars DataFrame from Python. - tidypolars
tidypolars
python library built on top of polars library that gives access to methods and functions familiar to R tidyverse users. - Working with Polars and XlsxWriter - Guide to using the Python XlsxWriter library with Polars to create Excel reports.
- Python package seaborn_polars - Python package to plot Polars DataFrames and LazyFrames with seaborn by @pavelcherepan.
- Python package functime - Machine learning Python package built on Polars for time-series predictions by @neocortexdb. According to the developpers, it's the world's fastest and most feature-full machine learning forecasting library !
Rust
- polars for Rust - Rust
polars
crate to use polars DataFrame with Rust. - Polars CLI
Polars CLI
is a command line interface for running SQL queries with Polars as backend. - GeoPolars
Geopolars
Rust crate that extends the Polars DataFrame library for use with geospatial data.
R
- rpolars for R - R
rpolars
package to use polars DataFrame from R. - tidypolars for R
tidypolars
package to use polars with tidyverse syntax.
Node.js
- nodejs-polars for Node.js - Node.js
nodejs-polars
package to use polars DataFrame from Node.js.
Scala/Java
- scala-polars for Scala and Java - Scala - Java
scala-polars
is a library for using Polars in Scala and Java projects by @chitralverma.
Ruby
- polars for Ruby - Ruby
polars-df
gems to use Polars with Ruby.
Resources
Cheat Sheets
- Polars Cheat Sheet - A Polars Cheat Sheet by @FranzDiebold.
Tutorials & workshops
- Modern Polars - A side by side comparison between Polars and Pandas containing code in both frameworks by @kevinheavey.
- Polars: um simples mas prático tutorial - Tutorial in the format of an ipynb notebook that illustrates several features of Polars in Portuguese by @barbosarafael. Associated github repository is here.
- A Practical Comparison of Polars and Pandas - A tutorial that showcases several common operations in Pandas and Polars side by side to demonstrate how much easier Polars is by @FlorianWilhelm. There is also an accompanying Jupyter notebook available.
- Prise en main de Polars - A notebook tutorial in French that illustrates the main features of Polars by @romaintailhurat and @linogaliana. There is also an accompanying blog post .
- Running Polars code distributedly - A page that explains how to rung Polars code distributedly with Fugue by @fugue-project.
- Converting SQL Queries to Polars DataFrames with JupySQL - A tutorial that explains how to convert SQL queries to Polars DataFrames using JupySQL by @ploomber.
- How to display Polars dataframes with itables - A tutorial that explains how to display Polars dataframes with itables by @mwouts.
- Rust Polars: Unlocking High-Performance Data Analysis — Part 1 - First part of an article that explores the world of Rust’s Polars and explain some basic concepts of Polars such as Series by @wiseaidev. Code used is available on Github here.
- Fast String Processing with Polars — Scam Emails Dataset - A tutorial using Polars to implement a text processing pipeline process by @AntonsRuberts. Code used is available on Github here.
- Cookbook Polars for R - A side-by-side comparison of Polars, R base, dplyr and data.table packages by @ddotta.
- Polars Workshop on AWS - A comprehensive workshop comparing Polars to Pandas, exploring a wide range of functions and features by @debnsuma.
- Polars cookbook in Python - This cookbook is a fork of the popular pandas-cookbook and has been modified to use the polars library. By @escobar-west, it uses real-world examples with "all the bugs and weirdness that entails."
- Data Pipelines with Polars: Step-by-Step Guide - A tutorial that explains how to build data pipelines with Polars by @AntonsRuberts. Code used is available on Github here.
- Python Polars: A Lightning-Fast DataFrame Library - A tutorial that shows how to use Polars with Python ecosystem by @hfhoffman1144. Code used is available on Github here.
Blog posts
- Using the Polars DataFrame Library - A blog post by Wei-Meng Lee to discover the basics of Polars and how it can be used in place of Pandas.
- Why Polars uses less memory than Pandas - A blog post by Itamar Turner-Trauring detailing some techniques to opptimize Pandas memory usage and see how Polars can provide an answer in some cases.
- Plodding with Polars in Python - A blog post by @amitrathore that introduces some basic features of Polars.
- Polars-lazy - A blog post by @ritchie46 and @jorgecarleitao that introduces Polars' lazy API in Rust.
- Series of posts on Polars - A series of blogpost on Polars usage with a lot of useful tricks and information by @braaannigan. Moreover, Liam also has a Data Analysis with Polars course on Udemy.
- Youtube videos about Polars - A series of short youtube videos about Polars by @braaannigan
- Alternatives to Pandas: Python Polars - An article that explores the Python Polars module as an alternative to Pandas, comparing their similarities and differences and providing some examples by @JohnLockwood
- Pandas vs Polars - A comparison on File I/O - A blog post that evaluates Polars and Pandas in terms of I/O performance and speed when handling large datasets by Wes Poulsen.
- Discover the Power of Polars Library for Fast and Efficient Data Manipulation in Python - An article that quickly compares Polars to other data manipulation libraries by Morpheus.
- Why is Polars All The Rage? - An article that explains why Polars will become very popular by SeattleDataGuy and Daniel Beach.
- Polars vs Pandas — 4 key concept differences - An article that helps to understand key differences between Pandas and Polars Data Science libraries by @DataScienceDisciple.
- Replacing Pandas with Polars. A Practical Guide - A blog post comparing some common functions between Pandas and Polars by @danielbeach. Code used is available on Github here.
- Dataframe Showdown – Polars vs Spark vs Pandas vs DataFusion. Guess who wins? - A short article that presents a performance test between Polars, Pandas, Datafusion and Spark on a csv dataset by @danielbeach. Code used is available on Github here.
- 7 Easy Steps To Switch From Pandas to Lightning Fast Polars And Never Return - A cheat sheet blog post of the most common Pandas operations translated into Polars by @BexTuychiev.
- Polars for initial data analysis, Polars for production - A blog post that shows how to use Polars for initial data analysis and then effectively in production by @itamarst.
- DuckDB vs Polars vs Spark! - An article that performs a benchmark against duckdb/Polars/spark, with varying row count, with swap usage as another metric, in addition to runtime in seconds. Code used is available on Github here.
- Benchmarking PySpark Pandas, Pandas UDFs, and Fugue Polars - A blog post that compares the execution time of fugue + Polars, Pandas UDFs and PySpark Pandas by @kvnkho.
- Pandas vs. Polars: The Battle of Performance - An another blog post that compares the performance between Pandas and Polars across a range of common data manipulation tasks by @makeuseofcode. Code used is available on Github.
- Pandas 2.0 vs Polars: The Ultimate Battle - A blog post that analyzes in terms of Syntax, Speed, and Usability between Pandas 2.0 and Polars 0.17.0 by @priyanshu7401.
- Polars - modern data frame library - A blog post that describes why Polars could be a better alternative to pandas, dplyr or data.table by @DSkrzypiec.
- The fastest way to read a CSV file in Python - A blog post that compares different ways (including Polars, pyarrow and C) to read a CSV file with Python by Finn Andersen.
- Pandas vs Polars vs Pandas 2.0 …. FIGHT - A blog post that does an ETL process for checking big data speed processing between Pandas, Pandas 2.0 and Polars by @guoliveira.
- Pandas vs Polars vs Pandas 2.0 … ROUND 2) - A blog post that makes a new comparison between Pandas, Pandas 2.0 and Polars by @guoliveira.
- Polars VS PySpark: Lazy Evaluation and Big Data - A blog post that compares lazy evaluation between Polars and Spark by @guoliveira.
- Polars in the aRtic! - An another blog post that compares the performance between Pandas and Polars across a range of common data manipulation tasks by @MCodrescu. Code used is available on Github.
- A Polars exploration into Kedro - A blog post that explains how Polars can be used instead of pandas in Kedro for your data catalog and data manipulation by @astrojuanlu.
- High Performance Data Manipulation in Python: pandas 2.0 vs. polars - A blog post that compares differences between Python pandas 2.0 and Polars libraries by @jcanalesluna.
- Lightning-fast queries with Polars - Another blog post that is a good introduction to Polars by @astrojuanlu.
- Polars – Laziness and SQL Context. - A blog post that presents two good reasons to adopt Polars : Lazy and SQL Context by @danielbeach.
- Exploring Polars - The Lightning-Fast DataFrame Library in Python - A blog post on the basics of Polars by @mddas.
- Pandas vs Polars – Speed Comparison - A blog post that compares the performance of Polars, Pandas and Pandas 2.0 by @StuffbyYuki. Code used is available on Github here.
- LazyFrame vs DataFrame in Polars – Performance Comparison - A blog post that introduces what LazyFrame is in Polars and its performance gain compared to DataFrame by @StuffbyYuki. Code used is available on Github here.
- Querying Polars DataFrames using SQL - A blog post that shows how to use the SQLContext object in Python to query a Polars DataFrame directly using SQL by @weimenglee.
- Polars vs Pandas: A Brief Tale of Two DataFrame Libraries - A blog post that compares Polars and Pandas focusing in particular on optional dependencies by @ranggakd.
- EDA with Polars: Step-by-Step Guide for Pandas Users (Part 1) - A blog post that describes the main data processing operations with Polars in Python by @AntonsRuberts. Code used is available in this notebook.
- EDA with Polars: Step-by-Step Guide to Aggregate and Analytic Functions (Part 2) - A blog post that shows how to perform with Polars and Python some fairly complex aggregates, rolling statistics and more by @AntonsRuberts. Code used is available in this notebook.
- Pyspark or Polars — What should you use? - A blog post that explores and breaks down some of the similarities between PySpark and Polars. It provides insights on when to choose one over the other by Vivek Kovvuru.
- Getting Started with the Polars Data Manipulation Library - A blog post that presents some simple features of Polars using Python by Juveriya Mahreen.
- 8 ways pandas really losing to Polars for quick market data analysis - A newsletter that compares the performance of Polars to Pandas for many common data manipulation techniques by PyQuant News.
- All that Polars that Make You Forget Pandas - A blog post that explores some deeper reasons behind the performance gains of Polars over Pandas.
- Polars vs Pandas. Inside an AWS Lambda - A blog post that covers the topic of using Polars vs Pandas inside an AWS Lambda to do data processing by @danielbeach. Code used is available on Github here.
- DuckDB vs Polars for Data Engineering - A blog post that compares Polars and DuckDB with pipelines for Data Engineering by @danielbeach.
- Pandas vs Polars: A database speed test. Who wins? - A blog post that compares the run-time of reading a database into a dataframe using Pandas versus using Polars by Thomas Reid.
- Polars and Pandas : What's the difference ? - A blog post that explains how Polars works under the hood and th best use cases for Polars and Pandas by @t-redactyl.
- Understanding the Polars nested column types - A blog post that helps to understand how nested column types works in Polars by @braaannigan.
- Polars vs DuckDB for Delta Lake ops - A blog post that compares Polars to DuckDB using Delta Lake by @wolliq.
Talks and videos
- Polars: Blazingly Fast DataFrames in Rust and Python ⏳
37 min
- Introduction to Polars by databricks. - Polars: The Next Big Python Data Science Library... written in Rust? ⏳
14 min
- A short video tutorial to get started coding with Polars by @RobMulla. - The Last Polars Dataframe vs. Pandas Dataframe Video You Should Ever See ⏳
19 min
- A video that compares Polars and Pandas data frames. - The Best library for building Data Pipelines... ⏳
12 min
- A video that compares Pandas, Spark and Polars for working with data in Python by @RobMulla. - Expressive & fast dataframes in Python with polars ⏳
28 min
- A video that reviews some alternatives to Pandas for Python and then demonstrates some Polars features by Juan Luis Cano Rodríguez. - Polars Introduction for Python with a 128GB Ryzen 24-core Benchmark vs Pandas ⏳
12 min
- A video that provides an introduction to Polars for Python by @jeffheaton. Notebook used for the video in this github repo. - Polars: The main alternative to pandas in Python!? ⏳
57 min
- A Polars tutorial series on Youtube by @martinbel. Notebooks and datasets used for the videos available in this github repo. - Polars vs Pandas ⏳
37 min
- A detailed video on Youtube that compares Polars and Pandas by @hu-po. - Polars: The Super Fast Dataframe Library for Python — Goodbye Pandas? - An article and a video ⏳
19 min
that explores some basic features of Polars by @ifrankandrade - Manipulación de Datos con Polars en python ⏳
51 min
- A detailed tutorial video in Spanish that shows 20 Polars functions to perform 80% of the tasks of a data scientist by Naren Castellon. - An opinionated introduction to Polars - Great Polars introduction slides from @krlng at PyCon 2023.
- Polars - make the switch to lightning-fast dataframes ⏳
30 min
- A talk that reports an experience switching from Pandas to Polars in a real-world ML project by @datenzauberai. Slides are available here. - Polars vs Pandas | detailed test with explained results ⏳
22 min
- A video that presents 8 distinct tests which demonstrates differences between Pandas and Polars by @vb100. Associated github repo is here. - Polars: A highly optimized dataframe library ⏳
20 min
- A video that presents some mains features of Polars by @mattharrison. - How to update mass data using Polars DataFrame ⏳
9 min
- A video that presents the process of writing code to update mass columns across CSV or data files by @AmitXShukla. Notebook used for the video in this github repo. - Using the Rust Polars DataFrame library in a CLI ⏳
4 min
- A video that shows how to integrate Polars in a commande line interface by @paiml. - The Ultimate Guide to Data Wrangling with Python | Rust Polars Data Frame ⏳
10 videos
- A playlist of 10 videos (WIP) that equips you with all the necessary knowledge required to utilize Python Polars Data Frame by @AmitXShukla.
Follow : Official
- pola-rs (@pola-rs) - Github organisation for Polars (Twitter: @DataPolars).
- Ritchie Vink (@ritchie46) - Author of Polars
- Stijn de Gooijer (@stinodego) - Member of Polars organisation
- Danny van Kooten (@dannyvankooten) - Member of Polars organisation
- Søren Havelund Welling (@sorhawell) - Member of Polars organisation
- Alexander Beedie (@alexander-beedie) - Contributor to Polars projects
- Marco Edward Gorelli (@MarcoGorelli) - Contributor to Polars projects
- Eitsupi (@eitsupi) - Contributor to R Polars project
- Etienne Bacher (@etiennebacher) - Contributor to R Polars project
Contributing
- Damien Dotta (@ddotta) - Maintainer of Awesome Polars list
Thanks goes to these contributors!