Problemsby GlyphDatabricks users keep filing bugs
34 posts from 21 people18d activeFading, +2 this week
Posts per day
The posts behind it
Help a [Databricks] idiot solve a problem - under pressure
...side. Let's say I have a variable [upstream] already called out named "customer_name". Is there a way to just replace the text of the variable name (not the value)?. Rinse and repeat with the next {{todays_date}} iteration of the text blob.. Not sure where to go with this. I'm...
What’s the most confusing Databricks error message you’ve ever seen?
...How long did it take you to figure it out?. Let’s make a list so the next person doesn’t waste hours on the same thing!.
Need help to get Databricks Voucher
Hello Everyone,. I'm looking for Databricks Data Engineer Professional Voucher. If someone has it please let me know! Thanks.
Micro app and stopage
Is ther any documentation about Micro Apps and when they stop (compute stop). is it when I close the tab in the browser or how do I make the stop app? .
Upstream to adbc-drivers/databricks: map not-found SQLSTATEs to StatusNotFound
Callers of the foundry Databricks driver cannot tell "object does not exist" from other failures without parsing message text. A code lets callers, including Fusion, decide without matching on error text. Map the verified not-found SQLSTATEs (`42P01`, `42704`, `42883`) to...
[v2 Bug][Databricks] Skip constraint metadata queries for unenforced incremental contracts
### Problem During Databricks Unity Catalog incremental relation-config reconciliation, Fusion's non-JSON fallback path fetches NOT NULL, primary-key, and foreign-key metadata even when the desired model contract is not enforced. These three `information_schema` reads are...
[Databricks] Explicit null merge_actions_explicit does not clear an inherited value
Follow-up to #16834 / #16835. In dbt-databricks, setting `merge_actions_explicit` to null on a model clears a value it inherits from `dbt_project.yml`, so the model falls back to the generated `WHEN` clauses. In Fusion the inherited value wins, so a folder-level explicit block...
[Databricks] ADBC driver does not report rows affected for queries that write rows
Part of #16932. Related: #16697. ### Problem Databricks tables, incremental models and snapshots show no row count in dbt v2. In the arrow-adbc Databricks driver (`go/adbc/driver/databricks`), `StatementExecuteQuery` hard-codes the rows-affected out-parameter to -1...
[v2 Bug] docs serve default target_path is resolved from CWD, not project dir (docs mismatch)
### Is this a new bug in dbt v2.x compared to the latest version of dbt 1.x? - [x] I believe this is a new bug in dbt v2.x - [x] I have searched the existing issues and could not find a duplicate ### Current Behavior It falls back to `./target` relative to CWD, and fails unless...
[PORT-OVER] Replace Databricks views in place in safer mode
Port of https://github.com/databricks/dbt-databricks/pull/1733 (resolves databricks/dbt-databricks#1714 there). Fusion's vendored Databricks `get_replace_sql` replaces a view with a view using `CREATE OR REPLACE VIEW` only when `use_safer_relation_operations` is off and the...
[PORT-OVER] Run Databricks views through one materialization lifecycle
Port of https://github.com/databricks/dbt-databricks/pull/1737. Fusion's vendored Databricks view materialization still has two bodies, picked by `use_materialization_v2()` (the project flag or the model config). With the flag off: - `view_update_via_alter: true` is ignored, so...
[PORT-OVER] Refresh Databricks views with wildcard queries on unchanged runs
Port of https://github.com/databricks/dbt-databricks/pull/1720. With `use_materialization_v2` and `view_update_via_alter` enabled, Fusion compares a view's compiled query with its stored definition. If an upstream table gains a column but the view still uses the same `SELECT *`...
[PORT-OVER] Handle Databricks transaction: false hooks without a literal COMMIT
Port of https://github.com/databricks/dbt-databricks/pull/1693, included in dbt-databricks 1.13.0. Databricks does not open a transaction for model execution. The global `run_hooks` macro can nevertheless send a literal `COMMIT` before an outside-transaction hook, causing...
Databricks Files API 3.0 (Beta) is out!
...parts separately using multipart uploads.. 2. Resumable downloads . This one was a major headache for me in V2 . If your download failed there was no way to resume it.. V3 supports HTTP range requests, so you can resume downloading from where it stopped instead of downloading...
What’s the most frustrating part of managing your data pipelines right now?
[PORT-OVER] Skip the Databricks view contract assertion under dbt clone
Port of https://github.com/databricks/dbt-databricks/pull/1742 (resolves databricks/dbt-databricks#1349). `dbt clone` builds every non-table node as a view, with SQL `select * from `. Fusion's vendored Databricks `validate_view_model` asserts the current model's enforced...
Cross-subscription/workspace data access pattern for PII data in Azure Databricks?
.../ Storage Credential grants?. 2) Unity Catalog cross-workspace binding / Delta Sharing?. Any advice, reference architecture, or lessons learned would be greatly appreciated!.
[Port] dbt-databricks#1726 Databricks column type checks to Fusion
Port [databricks/dbt-databricks#1726](https://github.com/databricks/dbt-databricks/pull/1726), which makes the Databricks column type checks recognize Databricks type names. For Databricks, Fusion's `Column.is_string()`, `is_integer()`, `is_float()` and `is_numeric()` compare...
Not able to access my account. Please Help
...Since postgres was running on my local machine and Databricks on the cloud there was no way to connect it directly. So, I had to host postgres on the internet using a secure TCP channel and connect Databricks to that endpoint so that it can access the database.. For this I had...
ai_transcribe
...get an alternative to whisper as a native function. . I just know whisper is pretty hard to beat, but it’s been around for ages so surely this might be able to give it a run for its money (unless they just whisper under the hood lmao). Anyway, was just wondering if anyone had a...
[v2 Bug] mixedCased incremental models are created new every time on databricks
### Is this a new bug in dbt v2.x compared to the latest version of dbt 1.x? - [x] I believe this is a new bug in dbt v2.x - [x] I have searched the existing issues and could not find a duplicate ### Current Behavior When you have a `mixedCase` named incremental model, dbt...
autoDetectColorScheme doesn't follow live OS theme changes on Linux/KDE Wayland: bundled Electron's nativeTheme.shouldUseDarkColors stays stale
### Summary On Linux (KDE Plasma 6, Wayland), `window.autoDetectColorScheme` picks the correct theme at startup but never follows OS light/dark changes while VS Code is running. The root cause appears to be the Electron build bundled with VS Code: `nativeTheme` emits `updated`...
[Fusion] Null-valued Databricks tags are omitted from the runtime model context
Fusion's model serializer recursively removes null-valued mapping entries when constructing the runtime Jinja `model` context. A null value can be meaningful user configuration: Databricks tags use it to represent a configured tag without a value. For example, a configured map...
[Databricks] Port MV/ST tag reconciliation from dbt-databricks #1686 to Fusion
## Goal Track the Fusion port of [dbt-databricks PR #1686](https://github.com/databricks/dbt-databricks/pull/1686): reconcile table and column tags for Databricks materialized views and streaming tables. ## Expected behavior - Apply configured table and column tags after...
[v2 Bug] Databricks tag dictionaries supplied through var() lose YAML declaration order
## Current behavior Databricks tag dictionaries supplied through `var()` lose their YAML declaration order before the tag-rendering macro receives them. Fusion renders the tag assignments alphabetically by key, while dbt Core v1 renders them in declaration order. For the fixture...
[Port] dbt-databricks#1410 skip empty-source incremental work in Fusion
Port [databricks/dbt-databricks#1410](https://github.com/databricks/dbt-databricks/pull/1410), which adds `skip_merge_on_empty_source` to avoid unnecessary Databricks incremental work when an eligible SQL source is empty. Fusion should match dbt-databricks: - Accept the opt-in...
[PORT-OVER] Emit Databricks constraint ALTER statements in a stable order
Port of https://github.com/databricks/dbt-databricks/pull/1698. On incremental runs, the vendored Databricks `apply_constraints` macro emits the `DROP CONSTRAINT`, `DROP/SET NOT NULL`, and `ADD CONSTRAINT` statements in the iteration order of the constraint diff. dbt-databricks...
expire_snapshots deletes current snapshot when min-snapshots-to-keep = 0
### Describe what's wrong - With table property `history.expire.min-snapshots-to-keep` set to `0`, `expire_snapshots` expires the current snapshot and deletes all data files. - Triggered by `expire_snapshots(retention_period = '1ms')`, or a no-arg call once the current snapshot...
Databricks custom PRIMARY KEY constraints with TIMESERIES or mixed-case columns are dropped on every incremental run
...CONSTRAINT ... CASCADE`, which also drops the foreign keys that reference it, and then fails to re-add it. The ADD statement is either a syntax error or names a column that does not exist. In the third case, a real change to the key is skipped. dbt-databricks fixes this in...
Customer Experience Engineer interview
.../ Advanced Cloud Engineer or a similar Azure Engineering role?. I’d really appreciate any advice on what areas I should focus on. How deep should I go into Azure services and AKS? . Thanks!.
Fabric Data Agent for Lakehouse - Couldn't add data source
I get a meaningless error when trying to initially add a brand new data source to a brand new data agent. The data source is a lakehouse (mirrored metadata lakehouse for databricks).. There are 5 simple tables in this lakehouse.. The only error message I received is like so:....
DP-700 Prep : Looking for advice from people who cleared it recently
...banks did you use, and what would you recommend I focus on given my background? . Also, any advice on what I should learn alongside DP-700 to actually make the transition into DE would be really helpful..
New API docs, first link I click is broken.
docs.databricks.com/api/workspace/ both links to Azure auth are broken. . New docs so far a step backwards. Also, no link to report issues, also feels like a middle finger. .
What is release status Databricks Micro Apps?
The serverless micro apps were announced at Summit , but can't seem to find the current status. Usually that means gated private preview, but wanted to confirm.. This post on Brickster.ai seems to be current and says as of this week still not released, but things change fast...
Companies and products named
About this problem
Evidence
34 posts from 21 people in 6 places, about 5 a week over 48 days. Mostly on dbt-labs/dbt, r/databricks, r/MicrosoftFabric. Tools named alongside: dbt, GitHub, Microsoft Azure, Microsoft Fabric.
Frustration Frustration 0 of 3· Seen on GitHub issues, Reddit
How it was grouped
Posts about Databricks that state a pain but match no known issue yet. First post Sep 19, 2026, latest Nov 5, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
Other Databricks problems
Trouble with Databricks table
Top post: "Unity Catalog client re-encodes or decodes a table location that contains a percent sequence", one of 8 posts from 8 people on GitHub issues, Reddit.
Modeling data in Databricks is unclear and hard to change
7 posts from 7 people on Reddit.
Databricks jobs fail silently or break often
5 posts from 5 people on GitHub issues, Reddit.
Trouble with Databricks catalog
Top post: "Spark support for Unity Catalog Iceberg", one of 4 posts from 4 people on Reddit, GitHub issues.
Bad data slips through Databricks unnoticed
3 posts from 3 people on Reddit.
Hard to trace lineage and find trusted data in Databricks
3 posts from 3 people on Reddit, GitHub issues.
Trouble with Databricks genie
Top post: "Databricks: support Genie consultations and resumable standalone tasks", one of 3 posts from 3 people on Reddit, GitHub issues.
Trouble with Databricks spark
Top post: "replaceUsing on partitioned tables fails with DELTA_FILE_TO_OVERWRITE_NOT_FOUND on local file:// paths", one of 3 posts from 3 people on GitHub issues.
Databricks tables suffer from small files and skew
3 posts from 3 people on Reddit, GitHub issues.
Databricks schema changes break downstream pipelines
3 posts from 3 people on GitHub issues, Reddit.
Databricks login, SSO or OAuth breaks
2 posts from 2 people on Stack Overflow, Reddit. Unverified.
Databricks vector search quality is hard to get right
2 posts from 2 people on Reddit. Unverified.
History