Trouble with Apache Airflow backend
Data engineering3 posts from 3 people3d active+00 posts in the last 7 days, 2 the 7 days before (fading)
Posts per day
The posts behind it
3, newest firstMake sure the Celery result backend works with psycopg3 upgrade### Body > [74581](https://github.com/apache/airflow/pull/74581) prepare_threshold=None applies to Airflow's metadata engines only. The commit message names the Celery result backend as out of scope and states a bare postgresql:// resolves to psycopg on SQLAlchemy 2.1. 3.4.0b1...apache/airflow · jason8104961 repliesOpen ↗XCom backend interface has no concept of dynamic regions, so storing looped TI's xcoms correctly is hardAffects 3.4.0: beta1 When I landed the 12 PR stack for Task Loops/AIP-111, we all (I and the reviewers) failed to catch that the custom XCom backend is only given the 4-tuple coordinates for the task (dag_id,run_id,task_id, map_index). While this is fine for both metadata (where...apache/airflow · ashbOpen ↗Support [workers] state_store_backend in language SDK tasks### Description `[workers] state_store_backend` lets a deployment keep large task and asset state store values in external storage. In a Python task, the task process calls the backend. On `set`, it stores the value and writes only a marker like `{"__airflow_state_ref__": " "}`...apache/airflow · Andrushika2 repliesOpen ↗
Companies and products named
About this problem
Evidence
3 posts from 3 people in 1 place, about 2 a week over 8 days. Mostly on apache/airflow. Tools named alongside: GitHub, PostgreSQL.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts about Apache Airflow with no known issue, sharing the word "backend". First post Oct 7, 2026, latest Oct 14, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
Other Apache Airflow problems
Apache Airflow is too complex to run wellApache Airflow users keep filing bugsApache Airflow jobs fail silently or break oftenApache Airflow upgrades break working setupsDebugging Apache Airflow failures is hardApache Airflow login, SSO or OAuth breaksApache Airflow backfills are slow and riskyTrouble with Apache Airflow dagsApache Airflow lock-in makes switching costlyApache Airflow runs out of memory
History
steady to fading
Trouble with Apache Airflow backend (3 posts)