Problemsby GlyphDatabricks jobs fail silently or break often
5 posts from 5 people5d activeFading, +0 this week
Posts per day
The posts behind it
What broke when we move to Unity Catalog
...to Unity Catalog. It went okay, but a few things broke along the way:. -Old table names stopped working. Our code used two-part names like schema.table. We had to update everything to the three-part format catalog.schema.table.. -Some jobs failed on shared clusters. A few of our...
[v2 Bug] [Databricks] connect_timeout does not cover the initial ping: dbt1308 "failed to ping database ... context deadline exceeded" persists on cold-starting compute
### Is this a new bug in dbt v2.x compared to the latest version of dbt 1.x? - [x] I believe this is a new bug in dbt v2.x - [x] I have searched the existing issues and could not find a duplicate This is a follow-up to #14529, which was closed after `connect_timeout` was wired...
Future dependencies CI jobs failing on github.com/godbus/dbus/v5 v5.2.3
### Which jobs are failing? ci-kubernetes-e2e-kind-dependencies, ci-kubernetes-unit-dependencies ### Which tests are failing? `hack/verify-typecheck.sh` after bumping all deps to latest: -...
Conditionally retrying a task on Lakeflow Jobs
...I've been diging into docs and forums, but I cannot find a native approach or non-patchy workaround to only retry on certain conditions (like based on exit codes).. So far, I've come with these candidate solutions:. - Just retrying everything (which doesn't makes sense cause if...
External jobs are never cancelled when a task fails terminally
### Summary An operator submits a job to an external system (Spark, Glue, Databricks, BigQuery) and polls it. If the task fails without being killed, and has no retries left, nothing cancels that external job. The Dag run finishes, the task is red, and the job keeps consuming...
Companies and products named
About this problem
Evidence
5 posts from 5 people in 4 places, about 1 a week over 62 days. Mostly on r/databricks, apache/airflow, kubernetes/kubernetes. Tools named alongside: GitHub, BigQuery, Apache Airflow, Kubernetes.
Frustration Frustration 0 of 3· Seen on GitHub issues, Reddit
How it was grouped
Posts that state a pain and match the "pipeline-failures" rule about Databricks. First post Aug 27, 2026, latest Oct 27, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
Data pipelines fail silently or break often
19 posts from 19 people on GitHub issues, Reddit, Stack Overflow.
Apache Airflow jobs fail silently or break often
13 posts from 12 people on GitHub issues, Stack Overflow.
Gemini jobs fail silently or break often
8 posts from 1 person on GitHub issues. Unverified.
PostgreSQL jobs fail silently or break often
5 posts from 4 people on GitHub issues.
GitHub jobs fail silently or break often
4 posts from 4 people on Reddit, GitHub issues.
ChatGPT jobs fail silently or break often
3 posts from 3 people on GitHub issues, Community forums.
Claude Code jobs fail silently or break often
3 posts from 3 people on GitHub issues.
GitLab jobs fail silently or break often
2 posts from 2 people on Stack Overflow. Unverified.
Docker jobs fail silently or break often
2 posts from 2 people on GitHub issues. Unverified.
Other Databricks problems
Trouble with Databricks table
Top post: "Unity Catalog client re-encodes or decodes a table location that contains a percent sequence", one of 8 posts from 8 people on GitHub issues, Reddit.
Modeling data in Databricks is unclear and hard to change
7 posts from 7 people on Reddit.
Trouble with Databricks catalog
Top post: "Spark support for Unity Catalog Iceberg", one of 4 posts from 4 people on Reddit, GitHub issues.
Bad data slips through Databricks unnoticed
3 posts from 3 people on Reddit.
Hard to trace lineage and find trusted data in Databricks
3 posts from 3 people on Reddit, GitHub issues.
Trouble with Databricks genie
Top post: "Databricks: support Genie consultations and resumable standalone tasks", one of 3 posts from 3 people on Reddit, GitHub issues.
Trouble with Databricks spark
Top post: "replaceUsing on partitioned tables fails with DELTA_FILE_TO_OVERWRITE_NOT_FOUND on local file:// paths", one of 3 posts from 3 people on GitHub issues.
Databricks tables suffer from small files and skew
3 posts from 3 people on Reddit, GitHub issues.
Databricks schema changes break downstream pipelines
3 posts from 3 people on GitHub issues, Reddit.
Databricks login, SSO or OAuth breaks
2 posts from 2 people on Stack Overflow, Reddit. Unverified.
Databricks vector search quality is hard to get right
2 posts from 2 people on Reddit. Unverified.
Databricks upgrades break working setups
2 posts from 2 people on GitHub issues. Unverified.
History