Data and AI struggles

1,730 problems · 342 companies

Outages and change

Apache Airflow upgrades break working setups

11 posts from 10 people10d activeSteady, +1 this week

Posts per day

Posts per day11 posts, Sep 1 to Nov 9

The posts behind it

GitHub issuesapache/airflow · dablaNov 3

Clearing with "run on latest version" permanently removes a mapped task's instances when its input's producer is cleared too

### Apache Airflow version main (3.4.0rc2 behaves the same) ### What happened? Clearing a DAG run's tasks with "run on latest version" when the cleared set includes the task that produces a mapped task's input marks every instance of the mapped task `removed`, and they stay...

2 replies
GitHub issuesapache/airflow · pavansai1997Nov 1

Add allowed_tables to LLMSQLQueryOperator to restrict the tables generated SQL may reference

### Description Add an opt-in `allowed_tables` parameter to `LLMSQLQueryOperator` (and `@task.llm_sql`) that rejects generated SQL referencing any table outside the list, reusing the enforcement `SQLToolset(allowed_tables=...)` already has. Today `table_names` only selects which...

2 replies
GitHub issuesapache/airflow · luc-pimentelOct 30

TS SDK: a task declared with `queue: undefined` loses the Dag queue and cannot run

### Under which category would you file this issue? Task SDK ### Apache Airflow version 3.4.0b2 with `apache-airflow-task-sdk` 1.4.0b2 and `apache-airflow-ts-sdk` 1.0.0-beta1; the serializer code is the same on main as of October 30, 2026. ### What happened and how to reproduce...

GitHub issuesapache/airflow · ChickenBennyOct 22

Make the supervisor the only clock for execution_timeout

### Under which category would you file this issue? Task SDK ### Apache Airflow version main ### What happened and how to reproduce it? Since #74869, the supervisor enforces `execution_timeout` for every task, using the value from `TIRunContext`. But it only acts...

GitHub issuesapache/airflow · gorewilliamsSep 27

apache-airflow-providers-google installs types-protobuf (a mypy stub package) as a runtime dependency

### Under which category would you file this issue? Providers ### Apache Airflow version Any (main / 3.x) ### What happened and how to reproduce it? `apache-airflow-providers-google` declares `types-protobuf`, a PEP 561 stub-only package consumed by mypy, as a runtime...

GitHub issuesapache/airflow · dheerajturagaSep 24

Cyclic TaskGroup dependencies break Grid/Graph since 3.3.1; proposed parse-time rejection is a breaking change

...3.3.x separately. 3. **What should 3.3.x users do in the meantime?** Currently the only workaround is to restructure the Dag: remove the cycle or flatten the affected TaskGroups. Tasks keep running and stay reachable through the REST API. 4. **Communication:** a `significant`...

1 reactions1 replies
GitHub issuesapache/airflow · zach-overflowSep 24

Add async support in `apache-airflow-client`

### Description Currently, the `apache-airflow-client` package (generated from the `openapi-generator-cli`) uses the default `urllib3` client, which does not support async operations. The proposed feature is to generate and package `async` client code in the...

4 replies
GitHub issuesapache/airflow · zoomingrocketSep 22

Airflow 3.3.2: LocalExecutor workers and DAG Processor child processes hang when OpenTelemetry is enabled

...enabled Description After upgrading from Airflow 3.1.8 to 3.3.2, the environment became unusable when OpenTelemetry was enabled. Two independent symptoms occur: **DAG Processor** DAG files are discovered normally. DAG Processor starts parser children. Child processes never...

5 replies
GitHub issuesapache/airflow · aroinaSep 14

Deferrable KubernetesPodOperator marks task SUCCESS without pushing XCom when the pod is gone at re-entry (regression from #66716, provider 10.17.1+)

### Apache Airflow Provider(s) cncf-kubernetes ### Versions of Apache Airflow Providers apache-airflow-providers-cncf-kubernetes==10.19.0 (observed in production). The code path is unchanged in 10.20.0, 10.21.0, 10.21.1 and on `main` as of today. Introduced in 10.17.1 by #66716...

1 reactions1 replies
GitHub issuesapache/airflow · avanish-gargSep 2

on_task_instance_up_for_retry

...built on `on_task_instance_failed` gets triggered on every transient retry of a flaky task, not just the final terminal failure, which undermines the signal-to-noise of building alerting on this hook. Airflow's listener spec already carves out sub-outcomes this way elsewhere -...

1 replies
GitHub issuesapache/airflow · avanish-gargSep 1

Listener hook can't distinguish a task auto-retrying from a terminal failure

...built on `on_task_instance_failed` gets triggered on every transient retry of a flaky task, not just the final terminal failure, which undermines the signal-to-noise of building alerting on this hook. Airflow's listener spec already carves out sub-outcomes this way elsewhere -...

3 replies

Companies and products named

4 posts
3 posts
2 posts
1 post
1 post
About this problem

Evidence

11 posts from 10 people in 1 place, about 1 a week over 64 days. Mostly on apache/airflow. Tools named alongside: GitHub, Kubernetes, Docker, Codex.

Frustration Frustration 1 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "breaking-changes" rule about Apache Airflow. First post Sep 1, 2026, latest Nov 3, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

The same problem elsewhere

GitHub upgrades break working setups

87 posts from 75 people on GitHub issues, Hacker News, Stack Overflow.

Upgrades and new releases break working setups

76 posts from 62 people on GitHub issues, Reddit, App Store reviews.

Claude Code upgrades break working setups

67 posts from 60 people on GitHub issues, Hacker News, Reddit.

Codex upgrades break working setups

65 posts from 58 people on GitHub issues, Reddit.

DuckDB upgrades break working setups

37 posts from 28 people on GitHub issues.

Claude upgrades break working setups

35 posts from 34 people on GitHub issues, Reddit, Hacker News.

ClickHouse upgrades break working setups

31 posts from 20 people on GitHub issues.

Anthropic upgrades break working setups

27 posts from 22 people on GitHub issues.

PyTorch upgrades break working setups

26 posts from 21 people on GitHub issues, Reddit.

ChatGPT upgrades break working setups

26 posts from 26 people on GitHub issues, Community forums, App Store reviews.

OpenAI upgrades break working setups

25 posts from 25 people on GitHub issues, Reddit, Community forums.

Open WebUI upgrades break working setups

25 posts from 2 people on GitHub issues.

Other Apache Airflow problems

Apache Airflow users keep filing bugs

Top post: "Status of testing Providers that were prepared on October 20, 2026", one of 41 posts from 31 people on GitHub issues, Reddit.

Apache Airflow is too complex to run well

34 posts from 32 people on GitHub issues.

Apache Airflow jobs fail silently or break often

13 posts from 12 people on GitHub issues, Stack Overflow.

Debugging Apache Airflow failures is hard

7 posts from 6 people on GitHub issues.

Apache Airflow login, SSO or OAuth breaks

4 posts from 3 people on GitHub issues.

Apache Airflow backfills are slow and risky

4 posts from 4 people on GitHub issues.

Trouble with Apache Airflow retry

Top post: "Task state store writes from `on_retry_callback` fail with 404", one of 3 posts from 3 people on GitHub issues.

Trouble with Apache Airflow dags

Top post: "DagModel.owners falls back to 'airflow' for Dags with only mapped tasks (LazyDeserializedDAG.owner ignores", one of 3 posts from 3 people on GitHub issues.

Trouble with Apache Airflow backend

Top post: "Support [workers] state_store_backend in language SDK tasks", one of 3 posts from 3 people on GitHub issues.

Apache Airflow lock-in makes switching costly

2 posts from 2 people on GitHub issues. Unverified.

Apache Airflow runs out of memory

2 posts from 2 people on GitHub issues. Unverified.

Apache Airflow permissions are confusing and error-prone

2 posts from 2 people on GitHub issues. Unverified.

History

Momentum went from rising to steady.

Nov 6, 2026

Momentum went from fading to rising.

Nov 4, 2026

Momentum went from steady to fading.

Oct 29, 2026

Momentum went from fading to steady.

Oct 27, 2026

Momentum went from rising to fading.

Oct 2, 2026

Momentum went from fading to rising.

Sep 28, 2026

First seen with 3 posts.

Sep 25, 2026