Problemsby GlyphTrouble with Apache Spark rows
3 posts from 3 people3d activeSteady, +1 this week
Posts per day
The posts behind it
scan_delta returns deleted rows from partitions whose path is percent-encoded
### Checks - [x] I have checked that this issue has not already been reported. - [x] I have confirmed this bug exists on the [latest version](https://pypi.org/project/polars/) of Polars. ### Reproducible example ### Log output ### Issue description Currently,...
Wrong result: LIMIT/OFFSET over LIMIT/OFFSET over a LEFT JOIN returns more rows than its LIMIT when adaptive query execution is on
...## To reproduce PySpark only; the two tables are inline; about a minute. ## Workaround `spark.sql.adaptive.enabled=false` for the statement. Output of the script: tallies and both formatted physical plans
Most efficient way to extract one field from a JSON string column in Spark (8-10B rows)
I have a Spark (Scala) DataFrame with about 8-10 billion rows. One column, meta_json , holds a JSON string. I need to pull out the label field as a new column.. Sample data. +----------+--------+-----------------------------+----+ |event_date|item_key|meta_json |qty |...
Companies and products named
About this problem
Evidence
3 posts from 3 people in 3 places, about 1 a week over 32 days. Mostly on Stack Overflow [apache-spark], apache/spark, pola-rs/polars. Tools named alongside: Polars, PyPI.
Frustration Frustration 0 of 3· Seen on GitHub issues, Stack Overflow
How it was grouped
Posts about Apache Spark with no known issue, sharing the word "rows". First post Sep 29, 2026, latest Oct 30, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
Other Apache Spark problems
Apache Spark users keep filing bugs
Top post: "Is a broadcast variable shared across multiple concurrent Spark jobs?", one of 14 posts from 13 people on GitHub issues, Reddit, Stack Overflow.
Apache Spark upgrades break working setups
4 posts from 4 people on GitHub issues.
Bad data slips through Apache Spark unnoticed
2 posts from 2 people on GitHub issues. Unverified.
History