Problemsby GlyphData engineering problems
Claude tables suffer from small files and skew
4 posts from 4 people on GitHub issues, Hacker News.
Hard to trace lineage and find trusted tables
21 posts from 21 people on GitHub issues, Reddit, Hacker News.
Apache Spark users keep filing bugs
Top post: "Is a broadcast variable shared across multiple concurrent Spark jobs?", one of 16 posts from 15 people on GitHub issues, Reddit, Stack Overflow.
Data pipelines fail silently or break often
19 posts from 19 people on GitHub issues, Reddit, Stack Overflow.
Migrating between platforms is slow and risky
30 posts from 29 people on Reddit, GitHub issues, Hacker News.
Apache Airflow users keep filing bugs
Top post: "Status of testing Providers that were prepared on October 20, 2026", one of 41 posts from 31 people on GitHub issues, Reddit.
pandas users keep filing bugs
Top post: ".to_latex() throws an exception in some cases", one of 26 posts from 19 people on GitHub issues, Stack Overflow, Reddit.
Bad data slips into production unnoticed
21 posts from 21 people on GitHub issues, Reddit, Stack Overflow.
Trouble with Polars column
Top post: "Compare lists in one column to the first n elements of another column in Python Polars lazyframes, where n is", one of 20 posts from 16 people on GitHub issues, Stack Overflow.
Streaming pipelines lag, drop or reorder events
14 posts from 14 people on GitHub issues, Stack Overflow.
Small files, skew and partitioning hurt performance
14 posts from 14 people on GitHub issues, Hacker News.
Migrating to or off GitHub is slow and risky
11 posts from 11 people on GitHub issues, Hacker News.
Apache Iceberg users keep filing bugs
Top post: "ORC: Writer accepts an empty struct that reader cannot bind", one of 11 posts from 10 people on GitHub issues, Reddit.
Claude Code tables suffer from small files and skew
9 posts from 9 people on GitHub issues, Reddit.
Hard to trace lineage and find trusted data in GitHub
7 posts from 7 people on GitHub issues, Reddit.
AWS Glue users keep filing bugs
Top post: "Which AWS Glue Schema Registry JAR dependencies are required for Confluent S3 Sink Connector on AWS MSK?", one of 4 posts from 4 people on GitHub issues, Stack Overflow.
Trouble with pandas index
Top post: "DOC: document `pd.Index.to_flat_index`", one of 4 posts from 4 people on GitHub issues.
Trouble with Databricks genie
Top post: "Databricks: support Genie consultations and resumable standalone tasks", one of 3 posts from 3 people on Reddit, GitHub issues.
Hard to trace lineage and find trusted data in Databricks
3 posts from 3 people on Reddit, GitHub issues.
Hard to trace lineage and find trusted data in ChatGPT
3 posts from 3 people on GitHub issues.
Migrating to or off Claude Code is slow and risky
2 posts from 2 people on GitHub issues, Hacker News. Unverified.
Microsoft Fabric tables suffer from small files and skew
2 posts from 2 people on GitHub issues, Stack Overflow. Unverified.
dbt users keep filing bugs
Top post: "dbt deps randomly fails with 500 Internal Server Error from codeload.github.com", one of 34 posts from 20 people on GitHub issues, Reddit, Community forums.
Snowflake users keep asking for help
Top post: "Frequency/histogram of an array", one of 31 posts from 27 people on Reddit, GitHub issues, Stack Overflow.
Polars users keep filing bugs
Top post: "Consider upgrading the brotli crate (CVE-2026-111497)", one of 22 posts from 15 people on GitHub issues.
Prefect users keep filing bugs
Top post: "Preferred way to cite prefect", one of 20 posts from 17 people on GitHub issues.
Trouble with Prefect flow
Top post: "Flow run graph polls graph-v2 every second for the whole run, rebuilding the full graph each time", one of 14 posts from 11 people on GitHub issues.
BigQuery users keep asking for help
Top post: "buildable indirect selection drops every test that reads a seed outside the selection", one of 14 posts from 14 people on GitHub issues, Stack Overflow, Reddit.
Apache Airflow jobs fail silently or break often
13 posts from 12 people on GitHub issues, Stack Overflow.
Airbyte users keep filing bugs
Top post: "Source Amazon Seller Partner: `posted-date` and `posted-date-time` always NULL in", one of 13 posts from 11 people on GitHub issues.
Trouble with Apache Iceberg table
Top post: "Parquet files written with the default CRS are not compatible with Iceberg Java EPSG:4326 table", one of 12 posts from 8 people on GitHub issues.
Apache Kafka users keep asking for help
Top post: "How to reference a file inside the current jar to be loaded in a library", one of 11 posts from 11 people on Stack Overflow, GitHub issues, Reddit.
Backfills are slow, costly and risky
10 posts from 10 people on GitHub issues, Reddit.
Microsoft Fabric users keep asking for help
Top post: "SQL: support time-zone-aware timestamps (CAST AS TIMESTAMPTZ / TIMESTAMP WITH TIME ZONE, AT TIME ZONE)", one of 10 posts from 9 people on Reddit, GitHub issues.
Data modeling choices are unclear and hard to change
9 posts from 9 people on Reddit, Hacker News, GitHub issues.
Trouble with Databricks table
Top post: "Unity Catalog client re-encodes or decodes a table location that contains a percent sequence", one of 8 posts from 8 people on GitHub issues, Reddit.
Trouble with pandas dataframe
Top post: "HDFStore.select with where=cat == None returns empty DataFrame for Categorical columns instead of matching", one of 8 posts from 7 people on GitHub issues, Stack Overflow.
Ingestion connectors and CDC are fragile
8 posts from 8 people on GitHub issues, Reddit.
Trouble with Apache Iceberg spark
Top post: "Spark: WAP snapshot isolation broken for format-version 3 tables when deletion vectors are used (spark.wap.id)", one of 7 posts from 7 people on GitHub issues.
Trouble with Polars unique
Top post: "Streaming engine: multi-column `.unique()` in `group_by().agg()` much slower than in-memory", one of 7 posts from 4 people on GitHub issues.
Trouble with Polars parquet
Top post: "`is_in` with more than 100 values does not skip Parquet row groups between the values", one of 7 posts from 7 people on GitHub issues.
Delta Lake users keep filing bugs
Top post: "version.sbt should be updated since 4.4.0 is out", one of 6 posts from 6 people on GitHub issues.