Polars runs out of memory
DevOps and infra3 posts from 3 people2d active+00 posts in the last 7 days, 0 the 7 days before (fading)
Posts per day
The posts behind it
3, newest firstHigh memory usage scanning IPC files with sliced string_view batches### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars. ### Reproducible example ### Log output ### Issue description Observed: 2,000 batches, each...pola-rs/polars · kdn36Open ↗Substantial memory amplification when constructing nested DataFrames from Python row dictionaries...no timezone fields, nulls, or wide/sparse schema, and uses an explicit schema. ### Workaround The following substantially reduced memory usage in the tested workloads: A larger application workload using this workaround also completed at 129,024 rows under the same 4 GiB...pola-rs/polars · kinowi1 repliesOpen ↗Streaming engine: `.over()` segfaults and returns incorrect results under cgroup memory pressure...allows projection pushdown to remove the window expressions before reaching the failing path. - 12 million rows. Tests with 4 million and 6 million rows produced no failures in 12 runs under verified reclaim. No specific thread count is required, but it affects memory demand and...pola-rs/polars · chuqCTC2 reactions, 3 repliesOpen ↗
Companies and products named
About this problem
Evidence
3 posts from 3 people in 1 place, about 1 a week over 35 days. Mostly on pola-rs/polars. Tools named alongside: PyPI, GitHub.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "oom" rule about Polars. First post Aug 28, 2026, latest Oct 1, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
Gemini runs out of memoryJobs and services run out of memoryGitHub runs out of memoryNVIDIA runs out of memoryDuckDB runs out of memoryApache Iceberg runs out of memoryvLLM runs out of memoryOllama runs out of memoryllama.cpp runs out of memoryApache Airflow runs out of memoryMistral runs out of memory
Other Polars problems
Polars users keep filing bugsPolars upgrades break working setupsTrouble with Polars streamingTrouble with Polars columnTrouble with Polars parquetTrouble with Polars joinBad data slips through Polars unnoticedTrouble with Polars structTrouble with Polars rollingTrouble with Polars dateTrouble with Polars mismatchTrouble with Polars input
History
rising to fading
Polars runs out of memory (3 posts)