Problemsby GlyphDebugging Apache Airflow failures is hard
7 posts from 6 people7d activeFading, +0 this week
Posts per day
The posts behind it
Language SDK task gets no task log when its runtime cannot launch
### Under which category would you file this issue? Task SDK ### Apache Airflow version 3.4.0b2 ### What happened and how to reproduce it? `supervise_task` reports a launch failure to the API server and the task log only when the coordinator raises `TaskLaunchError`....
Task keeps running after it is marked failed when the supervisor cannot write the task log (No space left on device)
...on would also avoid the orphan, but silently losing the task log seems worse than failing the task. ### Operating System Debian GNU/Linux 12 (bookworm), from the official apache/airflow:3.3.2 image ### Deployment Other Docker-based deployment ### Apache Airflow Provider(s) _No...
Language SDK task state writes skip the max_value_storage_bytes warning
### Description `[state_store] max_value_storage_bytes` caps the size of a task state value. The public REST API rejects an oversized value with a 422, and a Python task logs a warning and still writes the value (`task-sdk/src/airflow/sdk/execution_time/context.py`), so a...
Language SDK runtimes do not handle execution_timeout in the task process
### Under which category would you file this issue? Task SDK ### Apache Airflow version main ### What happened and how to reproduce it? A Python task has two layers for `execution_timeout`. The task runner raises `AirflowTaskTimeout` inside the task process when the time is up,...
Grid view: allow more than 50 Dag runs in "Number of Dag Runs" (restore 100 / 365)
...lost on tab switch; independent of this request but the two together make the grid hard to use for Dags with many runs ### Are you willing to submit a PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of...
AwsTaskLogFetcher can exit without reading the log events written at the end of an ECS task or Batch job
### Under which category would you file this issue? Providers ### Apache Airflow version 3.1.8 (the code below is unchanged on `main`, commit `49674b776d`) ### What happened and how to reproduce it? `AwsTaskLogFetcher` (used by `EcsRunTaskOperator` and, through...
KubernetesPodOperator: init_container_logs is silently ignored when deferrable=True
### Under which category would you file this issue? Providers ### Apache Airflow version 3.3.1 ### What happened and how to reproduce it? `KubernetesPodOperator.init_container_logs` only has an effect when `deferrable=False`. In the sync execution path, `execute_sync` calls...
Companies and products named
About this problem
Evidence
7 posts from 6 people in 1 place, about 1 a week over 51 days. Mostly on apache/airflow. Tools named alongside: GitHub, Docker, Kubernetes, PostgreSQL.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "orchestration-debugging" rule about Apache Airflow. First post Sep 4, 2026, latest Oct 24, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
Debugging orchestration and DAG failures is hard
5 posts from 5 people on GitHub issues.
Other Apache Airflow problems
Apache Airflow users keep filing bugs
Top post: "Status of testing Providers that were prepared on October 20, 2026", one of 41 posts from 31 people on GitHub issues, Reddit.
Apache Airflow is too complex to run well
34 posts from 32 people on GitHub issues.
Apache Airflow jobs fail silently or break often
13 posts from 12 people on GitHub issues, Stack Overflow.
Apache Airflow upgrades break working setups
11 posts from 10 people on GitHub issues.
Apache Airflow login, SSO or OAuth breaks
4 posts from 3 people on GitHub issues.
Apache Airflow backfills are slow and risky
4 posts from 4 people on GitHub issues.
Trouble with Apache Airflow retry
Top post: "Task state store writes from `on_retry_callback` fail with 404", one of 3 posts from 3 people on GitHub issues.
Trouble with Apache Airflow dags
Top post: "DagModel.owners falls back to 'airflow' for Dags with only mapped tasks (LazyDeserializedDAG.owner ignores", one of 3 posts from 3 people on GitHub issues.
Trouble with Apache Airflow backend
Top post: "Support [workers] state_store_backend in language SDK tasks", one of 3 posts from 3 people on GitHub issues.
Apache Airflow lock-in makes switching costly
2 posts from 2 people on GitHub issues. Unverified.
Apache Airflow runs out of memory
2 posts from 2 people on GitHub issues. Unverified.
Apache Airflow permissions are confusing and error-prone
2 posts from 2 people on GitHub issues. Unverified.
History