Problemsby GlyphApache Spark
Open source project15 problems49 posts+4 this week
Problem posts per week
Apache Spark problems
Hard to trace lineage and find trusted tables
21 posts from 21 people on GitHub issues, Reddit, Hacker News.
Apache Spark users keep filing bugs
Top post: "Is a broadcast variable shared across multiple concurrent Spark jobs?", one of 16 posts from 15 people on GitHub issues, Reddit, Stack Overflow.
Data pipelines fail silently or break often
19 posts from 19 people on GitHub issues, Reddit, Stack Overflow.
BigQuery users keep asking for help
Top post: "buildable indirect selection drops every test that reads a seed outside the selection", one of 14 posts from 14 people on GitHub issues, Stack Overflow, Reddit.
Trouble with Apache Spark rows
Top post: "scan_delta returns deleted rows from partitions whose path is percent-encoded", one of 4 posts from 4 people on GitHub issues, Stack Overflow.
Apache Spark upgrades break working setups
4 posts from 4 people on GitHub issues.
Databricks schema changes break downstream pipelines
3 posts from 3 people on GitHub issues, Reddit.
Databricks tables suffer from small files and skew
3 posts from 3 people on Reddit, GitHub issues.
Trouble with NVIDIA split
Top post: "Spark: Expose the effective split target size as a driver metric", one of 2 posts from 2 people on GitHub issues. Unverified.
Jira outages and slowdowns disrupt work
2 posts from 2 people on Reddit, GitHub issues. Unverified.
Bad data slips through Apache Spark unnoticed
2 posts from 2 people on GitHub issues. Unverified.
Modeling data in Microsoft Fabric is unclear and hard to change
2 posts from 2 people on Reddit. Unverified.
Great Expectations users keep asking for help
One post on Stack Overflow: "How to Pass and Reference Multiple Batches in a Great Expectations Custom SQL Query". Unverified.
Databricks users keep filing bugs
Top post: "autoDetectColorScheme doesn't follow live OS theme changes on Linux/KDE Wayland: bundled Electron's", one of 34 posts from 21 people on GitHub issues, Reddit.
About
Problems here are about Apache Spark or name it. It is tracked from the product list on the Method page. Website: spark.apache.org.