Data and AI struggles

1,274 problems · 305 companies

Data engineering

Trouble with Apache Airflow retry

3 posts from 3 people3d activeSteady, +1 this week

Posts per day

Posts per day3 posts, Sep 2 to Oct 27

The posts behind it

GitHub issuesapache/airflow · tatianaOct 22

Task state store writes from `on_retry_callback` fail with 404

### Apache Airflow version 3.3.2 (apache-airflow-task-sdk 1.3.2) ### What happened? A task that writes to `context["task_state_store"]` from `on_retry_callback` gets `ServerResponseError`. The execution API answers `404 {"detail":{"reason":"not_found","message":"Task instance...

10 replies
GitHub issuesapache/airflow · Sanjays2402Sep 25

max_db_retries performs one fewer retry than documented (tenacity counts the initial attempt)

`config_templates/config.yml` documents `max_db_retries` as "Number of times the code should be retried in case of DB Operational Errors." But `run_with_db_retries` in `airflow/utils/retries.py` passes it straight into `tenacity.stop_after_attempt(max_retries)`, and tenacity...

1 replies
GitHub issuesapache/airflow · manoj121999Sep 2

Show task retry timing details in task instance UI including the Jitter calculated

...can otherwise look like scheduler or executor delays, making expected backoff and jitter difficult to distinguish from operational latency. This PR makes the retry calculation visible in Task Instance details while the current attempt is in up_for_retry. ### Use case/motivation...

2 replies

Companies and products named

2 posts
1 post
1 post
About this problem

Evidence

3 posts from 3 people in 1 place, about 1 a week over 51 days. Mostly on apache/airflow. Tools named alongside: GitHub, dbt, SQLite.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts about Apache Airflow with no known issue, sharing the word "retry". First post Sep 2, 2026, latest Oct 22, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

Other Apache Airflow problems

Apache Airflow is too complex to run well

32 posts from 30 people on GitHub issues.

Apache Airflow users keep filing bugs

Top post: "Status of testing Providers that were prepared on October 20, 2026", one of 33 posts from 25 people on GitHub issues, Reddit.

Debugging Apache Airflow failures is hard

7 posts from 6 people on GitHub issues.

Apache Airflow jobs fail silently or break often

11 posts from 10 people on GitHub issues, Stack Overflow.

Apache Airflow upgrades break working setups

8 posts from 7 people on GitHub issues.

Apache Airflow login, SSO or OAuth breaks

4 posts from 3 people on GitHub issues.

Apache Airflow backfills are slow and risky

3 posts from 3 people on GitHub issues.

Trouble with Apache Airflow dags

Top post: "DagModel.owners falls back to 'airflow' for Dags with only mapped tasks (LazyDeserializedDAG.owner ignores", one of 3 posts from 3 people on GitHub issues.

Trouble with Apache Airflow backend

Top post: "Support [workers] state_store_backend in language SDK tasks", one of 3 posts from 3 people on GitHub issues.

Apache Airflow permissions are confusing and error-prone

2 posts from 2 people on GitHub issues. Unverified.

Apache Airflow lock-in makes switching costly

2 posts from 2 people on GitHub issues. Unverified.

Apache Airflow runs out of memory

2 posts from 2 people on GitHub issues. Unverified.

History

First seen with 3 posts; the top post now: "Task state store writes from `on_retry_callback` fail with 404".

Oct 27, 2026