Databricks is too complex to run well
2 posts from 2 people2d activeSteady, +1 this weekunverified
Posts per day
The posts behind it
DatabricksSQLStatementsSensor reports success without waiting for the statement when not deferrable
...and how to reproduce it? the bug and why it happens, a minimal Dag snippet with a failing statement, and the result from my run (task state=success, statement submitted=1x, state checked=0x). ### What you think should happen instead? the sensor should poll like any other sensor....
`BaseTrigger.on_kill` fails to complete if it takes more than 1 second
### Under which category would you file this issue? Airflow Core ### Apache Airflow version 3.3.2 ### What happened and how to reproduce it? #### The problem If a Trigger's `on_kill` method takes more than 1 second to run, it doesn't complete. This can leave external work...
Companies and products named
About this problem
Evidence
2 posts from 2 people in 1 place, about 1 a week over 17 days. Mostly on apache/airflow. Tools named alongside: Apache Airflow, GitHub, Kubernetes, Docker.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "k8s-complexity" rule about Databricks. First post Nov 2, 2026, latest Nov 18, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
Apache Airflow is too complex to run well
42 posts from 40 people on GitHub issues.
Kubernetes is too complex to run well
15 posts from 15 people on GitHub issues, Stack Overflow, Reddit.
Kubernetes is too complex for most teams
10 posts from 10 people on GitHub issues, Reddit.
Airbyte is too complex to run well
5 posts from 5 people on GitHub issues.
Claude Code is too complex to run well
5 posts from 4 people on GitHub issues.
PostgreSQL is too complex to run well
2 posts from 2 people on GitHub issues. Unverified.
Codex is too complex to run well
2 posts from 2 people on GitHub issues. Unverified.
PyPI is too complex to run well
2 posts from 2 people on GitHub issues. Unverified.
Google Cloud is too complex to run well
2 posts from 2 people on Reddit. Unverified.
Claude is too complex to run well
2 posts from 2 people on GitHub issues. Unverified.
Other Databricks problems
Databricks upgrades break working setups
4 posts from 4 people on GitHub issues.
Databricks users keep filing bugs
Top post: "autoDetectColorScheme doesn't follow live OS theme changes on Linux/KDE Wayland: bundled Electron's", one of 34 posts from 21 people on GitHub issues, Reddit.
Trouble with Databricks table
Top post: "DataLakeCatalog: `CREATE TABLE` on Databricks fails with `Unexpected location format: not_used/<table>`", one of 10 posts from 10 people on GitHub issues, Reddit.
Modeling data in Databricks is unclear and hard to change
7 posts from 7 people on Reddit.
Trouble with Databricks catalog
Top post: "scan_iceberg: use per-account ADLS SAS tokens (adls.sas-token.<account host>) vended by a REST catalog", one of 6 posts from 6 people on GitHub issues, Reddit.
Databricks jobs fail silently or break often
6 posts from 6 people on GitHub issues, Reddit.
Databricks tables suffer from small files and skew
5 posts from 5 people on GitHub issues, Reddit.
Bad data slips through Databricks unnoticed
3 posts from 3 people on Reddit.
Trouble with Databricks spark
Top post: "replaceUsing on partitioned tables fails with DELTA_FILE_TO_OVERWRITE_NOT_FOUND on local file:// paths", one of 3 posts from 3 people on GitHub issues.
Hard to trace lineage and find trusted data in Databricks
3 posts from 3 people on Reddit, GitHub issues.
Trouble with Databricks genie
Top post: "Databricks: support Genie consultations and resumable standalone tasks", one of 3 posts from 3 people on Reddit, GitHub issues.
Databricks schema changes break downstream pipelines
3 posts from 3 people on GitHub issues, Reddit.
History