Problemsby GlyphData engineering problems
Trouble with Apache Airflow backend
Top post: "Support [workers] state_store_backend in language SDK tasks", one of 3 posts from 3 people on GitHub issues.
Apache Iceberg connectors and syncs are fragile
3 posts from 3 people on GitHub issues.
Trouble with Polars streaming
Top post: "`min_by`/`max_by`/`sort_by` with a scalar `by`: in-memory engine raises, streaming broadcasts", one of 3 posts from 2 people on GitHub issues.
Trouble with Apache Airflow dags
Top post: "DagModel.owners falls back to 'airflow' for Dags with only mapped tasks (LazyDeserializedDAG.owner ignores", one of 3 posts from 3 people on GitHub issues.
Trouble with pandas dtype
Top post: "pd.to_numeric with errors=coerce fails to produce actual NA values when applied to dtype string[pyarrow]", one of 3 posts from 3 people on GitHub issues.
ChatGPT jobs fail silently or break often
3 posts from 3 people on GitHub issues, Community forums.
Trouble with Apache Kafka connect
Top post: "Kafka connect runtime 1.12.0 Azure Blob writes silently hang due to netty-tcnative/netty-handler", one of 3 posts from 3 people on GitHub issues.
ClickHouse schema changes break downstream pipelines
2 posts from 1 person on GitHub issues. Unverified.
Apache Flink connectors and syncs are fragile
2 posts from 2 people on GitHub issues. Unverified.
Docker tables suffer from small files and skew
2 posts from 2 people on GitHub issues. Unverified.
Trouble with Apache Iceberg pruning
Top post: "API: Predicate evaluation and file pruning treat -0.0 and 0.0 as different values", one of 2 posts from 2 people on GitHub issues. Unverified.
DuckDB schema changes break downstream pipelines
2 posts from 2 people on GitHub issues. Unverified.
Model, table and pipeline sprawl becomes unmanageable
2 posts from 2 people on GitHub issues, Reddit. Unverified.
Bad data slips through PostgreSQL unnoticed
2 posts from 2 people on Stack Overflow. Unverified.
SQL Server connectors and syncs are fragile
2 posts from 2 people on GitHub issues. Unverified.
Trouble with Databricks query
Top post: "How to debug remote_query() performance?", one of 2 posts from 2 people on Reddit. Unverified.
Hard to trace lineage and find trusted data in BigQuery
2 posts from 1 person on GitHub issues. Unverified.
Trouble with Polars cache
Top post: "Cache columns property", one of 2 posts from 2 people on GitHub issues. Unverified.
Trouble with dbt lint
Top post: "`dbt lint --fix` should expand `*` in `select *` into explicit columns", one of 2 posts from 2 people on GitHub issues. Unverified.
ClickHouse streams lag, drop or reorder events
2 posts from 2 people on GitHub issues, Reddit. Unverified.
Trouble with pandas column
Top post: "mean of column with numpy arrays stopped working in 3.1.0", one of 2 posts from 2 people on Stack Overflow, GitHub issues. Unverified.
Trouble with pandas attributeerror
Top post: "dateutil timezones raise AttributeError with python-dateutil 3.0", one of 2 posts from 2 people on GitHub issues. Unverified.
Trouble with pandas python
Top post: "`any()` and `all()` methods return inconsistent types based on underlying storage - should they always return", one of 2 posts from 2 people on Reddit, GitHub issues. Unverified.
Migrating to or off dbt is slow and risky
2 posts from 2 people on GitHub issues, Reddit. Unverified.
Azure Data Factory users keep asking for help
Top post: "Azure Data Factory: How to deploy changes independently for multiple teams using one shared ADF?", one of 2 posts from 2 people on Stack Overflow. Unverified.
Trouble with pandas numpy
Top post: "Supporting the new `np.minmax` reduction (and backing ufunc) coming in numpy 2.6.0", one of 2 posts from 2 people on GitHub issues. Unverified.
Apache Iceberg tables suffer from small files and skew
2 posts from 2 people on GitHub issues. Unverified.
Apache Kafka tables suffer from small files and skew
2 posts from 2 people on GitHub issues, Reddit. Unverified.
Trouble with Prefect deployment
Top post: "`prefect deployment delete --all` leaves deployments behind when there are more than 200", one of 2 posts from 2 people on GitHub issues. Unverified.
Migrating to or off Snowflake is slow and risky
2 posts from 2 people on Reddit. Unverified.
Vercel tables suffer from small files and skew
2 posts from 2 people on GitHub issues. Unverified.
Hard to trace lineage and find trusted data in Claude Code
2 posts from 2 people on GitHub issues. Unverified.
Migrating to or off GitHub Copilot is slow and risky
2 posts from 2 people on GitHub issues. Unverified.
Trouble with Apache Flink columns
Top post: "`VACUUM ... USING INVENTORY` rejects tables with non-nullable columns and comments", one of 2 posts from 2 people on GitHub issues. Unverified.
Trouble with Polars slice
Top post: "Predicate pushdown into a shared cache applies a filter below each branch's slice", one of 2 posts from 2 people on GitHub issues. Unverified.
Apache Flink schema changes break downstream pipelines
2 posts from 2 people on GitHub issues. Unverified.
Migrating to or off Cursor is slow and risky
2 posts from 2 people on Community forums. Unverified.
Trouble with pandas path
Top post: "TST: test_duplicated_hashtable_impl monkeypatches _SIZE_CUTOFF on a path that never reads it", one of 2 posts from 2 people on GitHub issues. Unverified.
Migrating to or off PostgreSQL is slow and risky
2 posts from 2 people on Hacker News, GitHub issues. Unverified.
Modeling data in GitHub Copilot is unclear and hard to change
2 posts from 2 people on Reddit. Unverified.
Bad data slips through Apache Spark unnoticed
2 posts from 2 people on GitHub issues. Unverified.
Trouble with Polars iceberg
Top post: "`sink_iceberg`: create the table when it does not exist", one of 2 posts from 1 person on GitHub issues. Unverified.
Apache Flink tables suffer from small files and skew
2 posts from 2 people on GitHub issues. Unverified.