DuckDB runs out of memory
DevOps and infra4 posts from 4 people4d active+00 posts in the last 7 days, 2 the 7 days before (fading)
Posts per day
The posts behind it
4, newest firstSIGSEGV in ~GroupedAggregateHashTable after an Out of Memory error: FinalizePinState on a partition whose append state was never initialised### What happens? A grouped aggregate whose aggregates have destructors (`string_agg(... ORDER BY ...)`, `quantile_cont`, `arg_min` on a hashed key) runs out of memory under `SET memory_limit`, and instead of returning the `Out of Memory Error` the process dies with SIGSEGV in...duckdb/duckdb · h4nsmullerOpen ↗INSERT ... ON CONFLICT inside a transaction holds ~32 KB per column per inserted row until commit (OOM on ~1,000-row transactions)### What happens? Inside an explicit transaction, every row inserted by `INSERT ... ON CONFLICT (id) DO UPDATE` holds about 32 KB **per column** of transaction-local storage (`duckdb_memory()` tag `IN_MEMORY_TABLE`) until commit. A plain `INSERT` of the same row holds about 0.2...duckdb/duckdb · dtubbOpen ↗Out-of-memory error in a hash aggregate with ordered list states aborts the process (exception thrown in ~GroupedAggregateHashTable)### What happens? A query that runs past `memory_limit` ends the process with `std::terminate` instead of returning an Out of Memory error. The backtrace shows an exception thrown inside a destructor while the failed query is cleaned up: In v1.5.1,...duckdb/duckdb · sounkou-bioinfoOpen ↗Consider a dedicated allocator for Windows embedded DuckDB workloads### What happens? ## Background I recently investigated a Windows performance problem in DuckDB when it is embedded in an R process hosted by Positron/RStudio. The investigation started from a substantial loss of DuckDB parallel performance after repeated workloads, and the...duckdb/duckdb · koenniemOpen ↗
Companies and products named
About this problem
Evidence
4 posts from 4 people in 1 place, about 1 a week over 24 days. Mostly on duckdb/duckdb. Tools named alongside: Positron, Segment.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "oom" rule about DuckDB. First post Sep 21, 2026, latest Oct 14, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
Gemini runs out of memoryJobs and services run out of memoryGitHub runs out of memoryNVIDIA runs out of memoryApache Iceberg runs out of memoryPolars runs out of memoryvLLM runs out of memoryOllama runs out of memoryllama.cpp runs out of memoryApache Airflow runs out of memoryMistral runs out of memory
Other DuckDB problems
DuckDB upgrades break working setupsDuckDB users keep filing bugsTrouble with DuckDB columnTrouble with DuckDB overflowDuckDB error messages are crypticTrouble with DuckDB internalTrouble with DuckDB nullTrouble with DuckDB valuesTrouble with DuckDB castTrouble with DuckDB resultDuckDB costs outgrow the value it givesDuckDB permissions are confusing and error-prone
History
steady to fading
unverified to corroborated
fading to steady
steady to fading
DuckDB runs out of memory (2 posts)