Data and AI struggles

2,149 problems · 379 companies

DevOps and infra

Databricks is too complex to run well

2 posts from 2 people2d activeSteady, +1 this weekunverified

Posts per day

Posts per day2 posts, Nov 2 to Nov 22

The posts behind it

GitHub issuesapache/airflow · firasbouzaziNov 18

DatabricksSQLStatementsSensor reports success without waiting for the statement when not deferrable

...and how to reproduce it? the bug and why it happens, a minimal Dag snippet with a failing statement, and the result from my run (task state=success, statement submitted=1x, state checked=0x). ### What you think should happen instead? the sensor should poll like any other sensor....

1 replies
GitHub issuesapache/airflow · diederikperdokNov 2

`BaseTrigger.on_kill` fails to complete if it takes more than 1 second

### Under which category would you file this issue? Airflow Core ### Apache Airflow version 3.3.2 ### What happened and how to reproduce it? #### The problem If a Trigger's `on_kill` method takes more than 1 second to run, it doesn't complete. This can leave external work...

2 replies

Companies and products named

2 posts
2 posts
2 posts
2 posts
About this problem

Evidence

2 posts from 2 people in 1 place, about 1 a week over 17 days. Mostly on apache/airflow. Tools named alongside: Apache Airflow, GitHub, Kubernetes, Docker.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "k8s-complexity" rule about Databricks. First post Nov 2, 2026, latest Nov 18, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Apache Airflow is too complex to run well

42 posts from 40 people on GitHub issues.

Kubernetes is too complex to run well

15 posts from 15 people on GitHub issues, Stack Overflow, Reddit.

Kubernetes is too complex for most teams

10 posts from 10 people on GitHub issues, Reddit.

Airbyte is too complex to run well

5 posts from 5 people on GitHub issues.

Claude Code is too complex to run well

5 posts from 4 people on GitHub issues.

PostgreSQL is too complex to run well

2 posts from 2 people on GitHub issues. Unverified.

Codex is too complex to run well

2 posts from 2 people on GitHub issues. Unverified.

PyPI is too complex to run well

2 posts from 2 people on GitHub issues. Unverified.

Google Cloud is too complex to run well

2 posts from 2 people on Reddit. Unverified.

Claude is too complex to run well

2 posts from 2 people on GitHub issues. Unverified.

Other Databricks problems

Databricks upgrades break working setups

4 posts from 4 people on GitHub issues.

Databricks users keep filing bugs

Top post: "autoDetectColorScheme doesn't follow live OS theme changes on Linux/KDE Wayland: bundled Electron's", one of 34 posts from 21 people on GitHub issues, Reddit.

Trouble with Databricks table

Top post: "DataLakeCatalog: `CREATE TABLE` on Databricks fails with `Unexpected location format: not_used/<table>`", one of 10 posts from 10 people on GitHub issues, Reddit.

Trouble with Databricks catalog

Top post: "scan_iceberg: use per-account ADLS SAS tokens (adls.sas-token.<account host>) vended by a REST catalog", one of 6 posts from 6 people on GitHub issues, Reddit.

Databricks jobs fail silently or break often

6 posts from 6 people on GitHub issues, Reddit.

Databricks tables suffer from small files and skew

5 posts from 5 people on GitHub issues, Reddit.

Bad data slips through Databricks unnoticed

3 posts from 3 people on Reddit.

Trouble with Databricks spark

Top post: "replaceUsing on partitioned tables fails with DELTA_FILE_TO_OVERWRITE_NOT_FOUND on local file:// paths", one of 3 posts from 3 people on GitHub issues.

Hard to trace lineage and find trusted data in Databricks

3 posts from 3 people on Reddit, GitHub issues.

Trouble with Databricks genie

Top post: "Databricks: support Genie consultations and resumable standalone tasks", one of 3 posts from 3 people on Reddit, GitHub issues.

Databricks schema changes break downstream pipelines

3 posts from 3 people on GitHub issues, Reddit.

History

First seen with 2 posts.

Nov 22, 2026