Data and AI struggles

2,149 problems · 379 companies

Data engineering

Hard to trace lineage and find trusted data in Apache Airflow

2 posts from 2 people2d activeSteady, +1 this weekunverified

Posts per day

Posts per day2 posts, Oct 30 to Nov 22

The posts behind it

GitHub issuesapache/airflow · rmittal46Nov 18

Conditional asset schedules: preserve partially satisfied branches instead of clearing the whole asset_dag_run_queue

...inputs that must land together. With the current behaviour, the `AND` semantics become unreliable as soon as another branch fires. The only workaround today is to create an intermediate "gate" Dag per `AssetAll` branch, each publishing its own asset, and schedule the consumer on...

1 replies
GitHub issuesapache/airflow · hanxdatadogOct 30

Feature: Run a Dag at any bundle version, including one with no Dag version yet (and use one "latest version" rule everywhere)

...That safety comes only from each query happening to order by number. As a result, every workaround is fragile: - storing the row under a synthetic `dag_id` (invisible to the UI); - renumbering versions so the extra row is never the highest, and backdating timestamps; - patching...

1 reactions2 replies

Companies and products named

2 posts
About this problem

Evidence

2 posts from 2 people in 1 place, about 1 a week over 20 days. Mostly on apache/airflow. Tools named alongside: GitHub.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "lineage-catalog" rule about Apache Airflow. First post Oct 30, 2026, latest Nov 18, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Hard to trace lineage and find trusted tables

19 posts from 19 people on GitHub issues, Reddit, Hacker News.

Hard to trace lineage and find trusted data in GitHub

8 posts from 7 people on GitHub issues, Reddit.

Hard to trace lineage and find trusted data in dbt

7 posts from 7 people on GitHub issues, Reddit.

Hard to trace lineage and find trusted data in Claude Code

3 posts from 3 people on GitHub issues, Reddit.

Hard to trace lineage and find trusted data in Databricks

3 posts from 3 people on Reddit, GitHub issues.

Hard to trace lineage and find trusted data in ChatGPT

3 posts from 3 people on GitHub issues.

Hard to trace lineage and find trusted data in Dagster

2 posts from 2 people on GitHub issues. Unverified.

Hard to trace lineage and find trusted data in Grafana

2 posts from 2 people on GitHub issues. Unverified.

Hard to trace lineage and find trusted data in Gemini

2 posts from 2 people on Hacker News, GitHub issues. Unverified.

Hard to trace lineage and find trusted data in BigQuery

2 posts from 1 person on GitHub issues. Unverified.

Hard to trace lineage and find trusted data in vLLM

2 posts from 2 people on GitHub issues. Unverified.

Other Apache Airflow problems

Apache Airflow backfills are slow and risky

9 posts from 9 people on GitHub issues.

Apache Airflow login, SSO or OAuth breaks

7 posts from 4 people on GitHub issues.

Apache Airflow users keep filing bugs

Top post: "Status of testing Providers that were prepared on October 20, 2026", one of 51 posts from 39 people on GitHub issues, Reddit.

Apache Airflow hits connection, locking and scaling limits

2 posts from 2 people on GitHub issues. Unverified.

Apache Airflow jobs fail silently or break often

16 posts from 15 people on GitHub issues, Stack Overflow.

Apache Airflow upgrades break working setups

14 posts from 12 people on GitHub issues.

Debugging Apache Airflow failures is hard

9 posts from 8 people on GitHub issues.

Trouble with Apache Airflow backend

Top post: "Trigger-written XComs bypass the configured XCom backend (raw rows mixed with externalized rows)", one of 4 posts from 4 people on GitHub issues.

Trouble with Apache Airflow dags

Top post: "DagModel.owners falls back to 'airflow' for Dags with only mapped tasks (LazyDeserializedDAG.owner ignores", one of 4 posts from 3 people on GitHub issues.

Apache Airflow permissions are confusing and error-prone

4 posts from 4 people on GitHub issues.

Apache Airflow lock-in makes switching costly

3 posts from 3 people on GitHub issues.

Trouble with Apache Airflow view

Top post: "Add Default DAG View preference to User Settings (Grid / Graph / Gantt)", one of 3 posts from 3 people on GitHub issues.

History

First seen with 2 posts.

Nov 22, 2026