Data and AI struggles

1,730 problems · 342 companies

Data engineering

Trouble with Polars parquet

7 posts from 7 people6d activeFading, +0 this week

Posts per day

Posts per day7 posts, Sep 3 to Nov 9

The posts behind it

GitHub issuespola-rs/polars · hanke580Oct 18

Parquet writer merges UInt64/UInt32 page statistics with a signed comparison (row-group min > max), so `scan_parquet` filters drop matching rows

### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars. ### Reproducible example Output: `df.lazy().sink_parquet("u64s.parquet", data_page_size=64)`...

1 reactions
GitHub issuespola-rs/polars · laughingman7743Oct 18

read_parquet(use_pyarrow=True) cannot read a remote directory or a list of remote files

### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars. ### Reproducible example ### Log output ### Issue description `read_parquet(source,...

GitHub issuespola-rs/polars · ndaskalovicOct 13

perf: `is_in` with more than 100 values does not skip Parquet row groups between the values

Row-group pruning for `is_in` is exact for up to 100 values (#27475). Above that, a row group is only skipped if it lies entirely outside `[min(values), max(values)]`, so row groups between the values are still read. On really large parquet where you may want to filter row...

3 reactions1 replies
GitHub issuespola-rs/polars · Azrail09CodeOct 7

Polars List type in sink_parquet discards Pyarrow metadata

### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars. ### Reproducible example ### Log output ### Issue description When saving a LazyFrame via...

GitHub issuespola-rs/polars · idanhazanOct 6

Panic in scan_parquet when filtering on a struct field if the struct contains a Datetime/Date field

### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars. ### Reproducible example ### Log output ### Issue description Filtering a scan_parquet on a...

GitHub issuespola-rs/polars · ion-elgrecoSep 6

int96 datetimes overflow when casted to microseconds precision during parquet scans

### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars. ### Reproducible example ### Log output ### Issue description Reading int96 datetimes...

1 reactions
GitHub issuespola-rs/polars · robertop-internSep 3

Custom `pyarrow_options` in `write_parquet` are overwritten by default function args

### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars. ### Reproducible example ### Log output ### Issue description Although the User specifically...

1 reactions1 replies

Companies and products named

7 posts
6 posts
About this problem

Evidence

7 posts from 7 people in 1 place, about 1 a week over 46 days. Mostly on pola-rs/polars. Tools named alongside: PyPI.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts about Polars with no known issue, sharing the word "parquet". First post Sep 3, 2026, latest Oct 18, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

Other Polars problems

Polars upgrades break working setups

23 posts from 16 people on GitHub issues.

Polars users keep filing bugs

Top post: "Consider upgrading the brotli crate (CVE-2026-111497)", one of 22 posts from 15 people on GitHub issues.

Trouble with Polars column

Top post: "Compare lists in one column to the first n elements of another column in Python Polars lazyframes, where n is", one of 20 posts from 16 people on GitHub issues, Stack Overflow.

Trouble with Polars unique

Top post: "Streaming engine: multi-column `.unique()` in `group_by().agg()` much slower than in-memory", one of 7 posts from 4 people on GitHub issues.

Trouble with Polars join

Top post: "Coalescing full join on Int32-vs-Int64 keys with `unique` incorrect", one of 6 posts from 6 people on GitHub issues.

Trouble with Polars instead

Top post: "Series.to_list() panics on out-of-range datetimes instead of raising an error", one of 6 posts from 6 people on GitHub issues.

Trouble with Polars group

Top post: "Datetime out-of-range in `group_by_dynamic` streaming engine", one of 4 posts from 3 people on GitHub issues.

Bad data slips through Polars unnoticed

3 posts from 3 people on GitHub issues, Reddit.

Polars runs out of memory

3 posts from 3 people on GitHub issues.

Trouble with Polars read

Top post: "`read_database` raises `ImportError` with SQLAlchemy 2.1 when `greenlet` is not installed", one of 3 posts from 3 people on GitHub issues.

Polars error messages are cryptic

3 posts from 2 people on GitHub issues.

Trouble with Polars value

Top post: "polars.read_excel() value error on very large date", one of 3 posts from 3 people on GitHub issues.

History

Momentum went from steady to fading.

Oct 25, 2026

Momentum went from fading to steady.

Oct 24, 2026

Momentum went from steady to fading.

Oct 20, 2026

Momentum went from fading to steady.

Oct 15, 2026

Momentum went from steady to fading.

Oct 14, 2026

Momentum went from rising to steady.

Oct 13, 2026

Corroborated: 3 or more posts from 2 or more people or places.

Oct 7, 2026

Momentum went from fading to rising.

Oct 7, 2026

First seen with 2 posts; the top post now: "`is_in` with more than 100 values does not skip Parquet row groups between the values".

Sep 25, 2026