Skip to content
Problems.

Apache Airflow jobs fail silently or break often

Data engineering4 posts from 4 people4d active+11 post in the last 7 days, 1 the 7 days before (steady)

Posts per day

Posts per day4 posts, Sep 8 to Sep 25

The posts behind it

4, newest first
PostDate
Add link from calendar cell to filter by the given date as start_date### Description When there is a dag failure in the calendar view for a given date then getting to the dagruns for the start date requires switching to the dagruns and then filtering by state. Since each cell is associated with a timestamp in case of daily or hourly runs clicking...apache/airflowtirkarthiSep 232 days ago
xcom_pull logs at ERROR level for an expected "XCom not found" case in Airflow 3.x Task SDK...the same reason, though that's a separate call site - happy to split if preferred.) ### Workaround `[logging] namespace_levels = airflow.sdk.api.client=CRITICAL` in `airflow.cfg` silences it, but that's an all-or-nothing hammer on the whole client logger (also silences genuine...apache/airflowrobertoroblesSep 1510 days ago
KubernetesPodOperator task is marked SUCCESS when the task process receives SIGTERM mid-execute (pod deleted by on_kill, cleanup() short-circuits on _killed)### Under which category would you file this issue? Providers ### Apache Airflow version 3.3.1 ### What happened and how to reproduce it? ### Issue Description When the task process running a `KubernetesPodOperator` receives `SIGTERM` while `execute()` is in flight, the task...apache/airflowadrianregoSep 112 weeks ago
TriggerDagRunOperator fails with a 404 "Dag run with run_id: 'manual__2026-09-08T02:35:00+00:00' not found"Using Airflow 3.3.1.. I am having trouble reproducing an error, but it's a consistent error.. Dag1 is responsible for fetching data from an external source, and saving a copy in a local cache. 1 dag run = 1 file in local cache. Many dags are dependent on this cache. The cache is...Stack Overflow [airflow]MrGumbleSep 82 weeks ago

Companies and products named

Company or productPosts naming it
Apache Airflow4
GitHub1
AWS1
Kubernetes1
About this problem

Evidence

4 posts from 4 people in 2 places, about 1 a week over 16 days. Mostly on apache/airflow, Stack Overflow [airflow]. Tools named alongside: GitHub, AWS, Kubernetes.

Frustration Frustration 0 of 3· Seen on GitHub issues, Stack Overflow

How it was grouped

Posts that state a pain and match the "pipeline-failures" rule about Apache Airflow. First post Sep 8, 2026, latest Sep 23, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

History

  • 2026-09-25 Added: Apache Airflow jobs fail silently or break often (4 posts)

Rising problems by email

Mondays: the problems in data, tech and AI that grew fastest that week.

Double opt-in. Unsubscribe any time.