Problemsby GlyphApache Spark upgrades break working setups
4 posts from 4 people4d activeFading, +0 this week
Posts per day
The posts behind it
[SPARK] Split wide join and aggregate outputs into methods under whole-stage codegen
### What changes were proposed in this pull request? Wrap wide output evaluation in join operators (`SortMergeJoinExec`, `BroadcastHashJoinExec`) and `HashAggregateExec` into separate methods to keep the generated `processNext()` method under HotSpot's 8,000-byte JIT compilation...
Shuffle tracking prevents dynamic allocation from removing executors after `collect()` / `toPandas()`
When using dynamic allocation with shuffle tracking enabled, executors that participated in a shuffle remain alive indefinitely after a `collect()` or `toPandas()` action has completed. Configuration: For example: After the action completes, the executors that produced shuffle...
Add linear regression aggregation functions (regr_slope, regr_intercept, regr_r2, regr_count)
### Description I'd like to propose adding the core SQL-standard **linear regression aggregation functions** to Polars: - `pl.regr_slope(y, x)` - slope of the least-squares linear fit of `y` on `x` - `pl.regr_intercept(y, x)` - intercept of the fit - `pl.regr_r2(y, x)` -...
[SQL] State-store instance metrics are shipped in every task result
## Summary Stateful operators currently create one state-store instance metric accumulator for every combination of: Every task then receives and registers all of those accumulators, even though it processes only one state partition. On task completion, all external accumulators...
Companies and products named
About this problem
Evidence
4 posts from 4 people in 2 places, about 1 a week over 59 days. Mostly on apache/spark, pola-rs/polars. Tools named alongside: Polars, DuckDB, PostgreSQL.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "breaking-changes" rule about Apache Spark. First post Aug 28, 2026, latest Oct 25, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
GitHub upgrades break working setups
87 posts from 75 people on GitHub issues, Hacker News, Stack Overflow.
Upgrades and new releases break working setups
76 posts from 62 people on GitHub issues, Reddit, App Store reviews.
Claude Code upgrades break working setups
67 posts from 60 people on GitHub issues, Hacker News, Reddit.
Codex upgrades break working setups
65 posts from 58 people on GitHub issues, Reddit.
DuckDB upgrades break working setups
37 posts from 28 people on GitHub issues.
Claude upgrades break working setups
35 posts from 34 people on GitHub issues, Reddit, Hacker News.
ClickHouse upgrades break working setups
31 posts from 20 people on GitHub issues.
Anthropic upgrades break working setups
27 posts from 22 people on GitHub issues.
PyTorch upgrades break working setups
26 posts from 21 people on GitHub issues, Reddit.
ChatGPT upgrades break working setups
26 posts from 26 people on GitHub issues, Community forums, App Store reviews.
OpenAI upgrades break working setups
25 posts from 25 people on GitHub issues, Reddit, Community forums.
Open WebUI upgrades break working setups
25 posts from 2 people on GitHub issues.
Other Apache Spark problems
Apache Spark users keep filing bugs
Top post: "Is a broadcast variable shared across multiple concurrent Spark jobs?", one of 16 posts from 15 people on GitHub issues, Reddit, Stack Overflow.
Trouble with Apache Spark rows
Top post: "scan_delta returns deleted rows from partitions whose path is percent-encoded", one of 4 posts from 4 people on GitHub issues, Stack Overflow.
Bad data slips through Apache Spark unnoticed
2 posts from 2 people on GitHub issues. Unverified.
History