Data and AI struggles

1,730 problems · 342 companies

Data engineering

Hard to trace lineage and find trusted tables

21 posts from 21 people17d activeSteady, +2 this week

Posts per day

Posts per day21 posts, Sep 1 to Nov 9

The posts behind it

GitHub issuesopenai/codex · xueshi1992-sourceNov 4

[macOS/Windows Desktop] New Codex Cloud conversations work in Chrome but never appear in desktop sidebar

...If related to existing reports, please cross-link/consolidate and identify a supported workaround or fixed release. Potentially related but not known to share a root cause: - #58424 - Windows Codex cloud conversations absent from desktop while visible in Chrome. - #51675 - macOS...

2 reactions2 replies
GitHub issuesvllm-project/vllm · michael-gpuNov 3

[Bug][Spec Decode] DSD K=0: draft-KV retention cost under batch-size ladders + tier-edge release design (with high-concurrency corroboration for #53426)

## Overview Under Dynamic Speculative Decoding tables that resolve K=0 at high concurrency (the serving regime - #53420, #53426), the draft KV cache is a separate group whose blocks are per-request and freed only at request completion. Requests that speculated during the K>0...

GitHub issuesapache/airflow · hanxdatadogOct 30

Feature: Run a Dag at any bundle version, including one with no Dag version yet (and use one "latest version" rule everywhere)

...That safety comes only from each query happening to order by number. As a result, every workaround is fragile: - storing the row under a synthetic `dag_id` (invisible to the UI); - renumbering versions so the extra row is never the highest, and backdating timestamps; - patching...

1 reactions2 replies
Redditr/cscareerquestions · u/OkAerie7822Oct 29

How do you review code you couldn't have written yourself? These are the 5 questions I ask of any diff

...of questions that doesn't depend on who wrote the diff. Mine:. How would I know this is broken? Which alert, log line or failing check tells me within minutes, not weeks.. How do I roll it back? A revert, a flag, a down migration. If the answer is "restore from backup", the...

GitHub issuesmlflow/mlflow · sunilmehta-siOct 23

[FR] Option to skip the registered_model_meta file on models:/ downloads, so a downloaded model can be verified against its signature

...models from the MLflow registry has to special-case this one file. There is currently no way to turn it off; the only options are to exclude the file by name in every verifier, or to delete it after download and before verifying. > Why is this use case valuable to support for...

1 replies
GitHub issuesapache/iceberg · maomaodevOct 11

Spark: scala.MatchError in `RewriteOperationForRowLineage` for non-Iceberg tables

### Apache Iceberg version 1.10.1 ### Query engine Spark ### Please describe the bug 🐞 The rules `RewriteUpdateTableForRowLineage` and `RewriteMergeIntoTableForRowLineage` (both extending `RewriteOperationForRowLineage`) are injected into the Spark Analyzer by...

GitHub issuesapache/airflow · cduarte-taOct 8

Snowflake OpenLineage: per-task QUERY_HISTORY() lookup is slow, can miss the query, and cannot be disabled without losing lineage

...it can return no row because of the 100-row default `RESULT_LIMIT`, and there's no way to turn it off without disabling lineage entirely. Switching to `QUERY_HISTORY_BY_USER()` with a time window was about 2.7× faster and always found the row in our tests. Making the lookup...

2 replies
GitHub issuesdbt-labs/dbt · koletzillaOct 7

[ClickHouse] Add column-level lineage support

...feature for? dbt v2.x (Core or Fusion) ### Describe the feature Column-level lineage does not work for ClickHouse projects on dbt v2. With a default ClickHouse project, the lineage view in dbt platform shows a parsing error for every model, and the local docs site has no column...

Redditr/dataengineering · u/Actual_Plant_862Oct 7

Creating a scalable data engineering platform as a newbie

...little experience in that field and I'm not sure how to go about it and could really use advice on how to implement a scalable platform that includes some kind of metadata management..

GitHub issuesgrafana/grafana · NWRichmondOct 6

Apply untouched/engaged close rules and keep the entry pill when Assistant is unavailable

...commit per ticket. Branch from `main`, which already includes grafana/grafana#134206. ## Blocked by * [Replace the Query Coauthoring session precedence chain with a reducer]( )

GitHub issuesdbt-labs/dbt · elephantmetropolisOct 6

[v2 Bug] DuckDB: source schema download ignores `external_location`, disabling static analysis for file-backed sources

### Is this a new bug in dbt v2.x compared to the latest version of dbt 1.x? - [x] I believe this is a new bug in dbt v2.x - [x] I have searched the existing issues and could not find a duplicate ### Current Behavior With `--static-analysis strict`, dbt v2 fetches the source...

GitHub issueshashicorp/terraform · BaoZhiFeiOct 4

Equivalent check results can spuriously increment remote state serial and invalidate saved plans

### Terraform Version Terraform v1.18.0-dev, built from `db4eef44f5bbd39a115f939304279caee7cf9b12` plus an unrelated OSS authentication patch. The same affected code is still present on current `main` at `d8e7252bce0f6b363c3c5ef26eb6d343395b5f5f`. ### Terraform Configuration...

1 reactions2 replies
GitHub issuesmodelcontextprotocol/servers · cliffhallOct 4

PR template: reduce to the issues-not-PRs banner; move the maintainers' checklist to AGENTS.md and pr-flow

## Problem `.github/pull_request_template.md` on `v2/main` carries three things: an HTML comment restating the "issues, not PRs" policy, the **Heads up** banner, and the maintainers' PR skeleton (`Closes #`, Description, Server Details, Motivation, How Has This Been Tested?,...

1 replies
GitHub issueslangchain-ai/langchain · deepak25000000Sep 23

docs: AGENTS.md setup commands fail at repo root; structure/list/CI-claim mismatches in README and pr_lint

### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...

2 replies
Redditr/analytics · u/Stiven_TrafficLabSep 13

What’s the smallest analytics stack you’d trust for real decisions?

...track sessions, users, events, heatmaps, Search Console data and server logs, then still struggle to answer a basic question:. Did anything actually improve?. Traffic is an obvious example. Sessions can increase while lead quality, conversion rate or revenue per user falls. A...

GitHub issuesmicrosoft/vscode · mrleemurraySep 3

Evolving the VS Code Interface

We are updating the VS Code interface to make it clearer, more consistent, and easier to adapt to different screens, accessibility needs, and working styles. Change can be disruptive, especially in a tool people use every day. Feedback on the modern UI has already helped us...

63 reactions51 replies
GitHub issuesdagster-io/dagster · derHeinzerSep 3

Stale / incorrect asset lineage in Dagster UI after code location deployments

### What's the issue? We are experiencing an intermittent issue with the Dagster UI where the asset lineage/asset graph is stale or incorrect after deploying updated code locations. Our setup consists of an open-source Dagster deployment on GKE. When a code location is...

7 reactions
GitHub issuesapache/spark · jarredhj0214Sep 1

[SQL] Support fallback resolver for unknown V2 catalog names

### Problem We are using Spark 3.3.2 with Apache Gravitino and observed that all top-level V2 catalogs need to be registered eagerly through Spark configuration: This appears to be a general limitation of Spark's V2 catalog lookup model rather than a version-specific bug. I also...

1 replies

Companies and products named

4 posts
2 posts
1 post
1 post
About this problem

Evidence

21 posts from 21 people in 18 places, about 2 a week over 65 days. Mostly on Hacker News comments, apache/airflow, dbt-labs/dbt. Tools named alongside: GitHub, Apache Airflow, dbt, Apache Spark.

Frustration Frustration 1 of 3· Seen on GitHub issues, Reddit, Hacker News, Mastodon

How it was grouped

Posts that state a pain and match the "lineage-catalog" rule. First post Sep 1, 2026, latest Nov 4, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

The same problem elsewhere

Hard to trace lineage and find trusted data in GitHub

7 posts from 7 people on GitHub issues, Reddit.

Hard to trace lineage and find trusted data in dbt

6 posts from 6 people on GitHub issues, Reddit.

Hard to trace lineage and find trusted data in Databricks

3 posts from 3 people on Reddit, GitHub issues.

Hard to trace lineage and find trusted data in ChatGPT

3 posts from 3 people on GitHub issues.

Hard to trace lineage and find trusted data in Claude Code

2 posts from 2 people on GitHub issues. Unverified.

Hard to trace lineage and find trusted data in BigQuery

2 posts from 1 person on GitHub issues. Unverified.

History

Momentum went from fading to steady.

Nov 7, 2026

Momentum went from steady to fading.

Nov 6, 2026

Momentum went from fading to steady.

Nov 2, 2026

Momentum went from steady to fading.

Oct 30, 2026

Momentum went from fading to steady.

Oct 21, 2026

Momentum went from steady to fading.

Oct 13, 2026

Momentum went from fading to steady.

Oct 12, 2026

Momentum went from rising to fading.

Oct 11, 2026

Momentum went from steady to rising.

Oct 8, 2026

Momentum went from fading to steady.

Oct 4, 2026

Momentum went from rising to fading.

Oct 2, 2026

Momentum went from steady to rising.

Sep 25, 2026