Apache Iceberg runs out of memory

DevOps and infra4 posts from 3 people4d active+00 posts in the last 7 days, 1 the 7 days before (fading)

Posts per day4 posts, Sep 4 to Oct 21

The posts behind it

4, newest first

GitHub issuesOct 9 Regression on main: TPC-DS Q4 over scan_iceberg goes OOM in seconds once its joins are reordered (2.0.0: 34 s, 2.5 GiB)### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the latest version of Polars (main, pola-rs/polars@c36581695d). ### Reproducible example Needs `polars duckdb "pyiceberg[sql-sqlite,pyarrow]" psutil`. It...pola-rs/polars · djouallah1 reactionsOpen ↗GitHub issuesOct 6 scan_iceberg: TPC-DS Q72 is ~100x slower and grows memory until OOM, vs scan_parquet on the same files### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the latest version of Polars. ### Reproducible example Needs `polars duckdb "pyiceberg[sql-sqlite,pyarrow]" psutil`. It generates TPC-DS SF=1 with DuckDB's...pola-rs/polars · djouallahOpen ↗GitHub issuesOct 5 Core: AuthSessionCache's exiting evictor pool registers a never-removed JVM shutdown hook per OAuth2Manager, pinning the creating thread's inheritable thread-locals (leaks closed Spark sessions)### Apache Iceberg version 1.11.0 (also present on `main` today: `core/src/main/java/org/apache/iceberg/rest/auth/AuthSessionCache.java` L54-58, `OAuth2Manager.java` L216-217, `util/ThreadPools.java` L101-104) ### Query engine Spark 4.1.1, as a long-lived Spark Connect server...apache/iceberg · Kingsley-working3 repliesOpen ↗GitHub issuesSep 4 Spark: Async micro-batch preload does not stop when either limit is reached# Spark: Async micro-batch preload does not stop when either limit is reached ### Apache Iceberg version `main` (`0107f19a4a`); present in Spark 3.5, 4.0, and 4.1. ### Query engine Spark Structured Streaming with `async-micro-batch-planning-enabled=true`. ### Description...apache/iceberg · iamrajatranaOpen ↗

Companies and products named

Named4 posts

Apache Iceberg Named2 posts

About this problem

Evidence

4 posts from 3 people in 2 places, about 1 a week over 36 days. Mostly on apache/iceberg, pola-rs/polars. Tools named alongside: Polars, DuckDB, SQLite, GitHub.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "oom" rule about Apache Iceberg. First post Sep 4, 2026, latest Oct 9, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

The same problem elsewhere

Elsewhere9 postsGemini runs out of memory Elsewhere9 postsJobs and services run out of memory Elsewhere5 postsGitHub runs out of memory Elsewhere4 postsNVIDIA runs out of memory Elsewhere4 postsDuckDB runs out of memory Elsewhere3 postsPolars runs out of memory Elsewhere2 postsvLLM runs out of memory Elsewhere2 postsOllama runs out of memory Elsewhere2 postsllama.cpp runs out of memory Elsewhere2 postsApache Airflow runs out of memory Elsewhere2 postsMistral runs out of memory

Other Apache Iceberg problems

Same product11 postsApache Iceberg users keep filing bugs Same product8 postsTrouble with Apache Iceberg table Same product5 postsTrouble with Apache Iceberg rest Same product3 postsApache Iceberg connectors and syncs are fragile Same product3 postsTrouble with Apache Iceberg spark Same product2 postsTrouble with Apache Iceberg delete Same product2 postsApache Iceberg schema changes break downstream pipelines Same product2 postsApache Iceberg deprecations force unplanned migrations Same product1 postTrouble with Apache Iceberg rows Same product1 postTrouble with Apache Iceberg drop Same product1 postTrouble with Apache Iceberg scan

History

MomentumOct 16, 2026steady to fading

MomentumOct 15, 2026fading to steady

MomentumOct 13, 2026steady to fading

MomentumOct 12, 2026rising to steady

AddedOct 7, 2026Apache Iceberg runs out of memory (3 posts)