Data and AI struggles

1,730 problems · 342 companies

Data engineering

Ingestion connectors and CDC are fragile

8 posts from 8 people7d activeFading, +0 this week

Posts per day

Posts per day8 posts, Sep 4 to Nov 9

The posts behind it

Redditr/databricks · u/Alone-Security7044Oct 30

dbt users on Databricks: do your snapshots handle files that arrive out of order?

...columns changed), per-batch row counts, and an error log for duplicate keys instead of failing the run.. dbt Hub: https://hub.getdbt.com/mercedes-benz/dbt_iterative_snapshot/latest/ . . GitHub: https://github.com/mercedes-benz/dbt-iterative-snapshot . It's dbt-databricks only...

GitHub issuesopenai/codex · Liyuhao02Oct 28

[App][Plugins] iCloud Calendar returns -32603 Internal error after reconnecting; Mail works

## Summary The official OpenAI iCloud Calendar plugin repeatedly returns `Mcp error: -32603: Internal error` for both calendar listing and event search. Reconnecting the Calendar account did not resolve the failure. The account owner also reports that calendar queries fail in a...

4 reactions3 replies
GitHub issuesopenai/codex · carlhiggs-archOct 20

Codex Document Control fails with 403: arc control transport is not enabled

...This blocks controlled background Word editing and PDF production. The only remaining workaround is visible desktop interaction, which interrupts the user and can require repeated mouse and approval actions. Client information, document contents, email addresses and local file...

3 reactions6 replies
Redditr/SQL · u/Klutzy_Solid5200Sep 30

What is the best way to handle incremental loads in sql?

...especially when there is no delete flag in the source?. Also, are there any common problems with using timestamps for incremental loads, like missing records or picking up the same record more than once?.

Redditr/dataengineering · u/MoradistenSep 30

We were struggling to find Data Engineers

Hi everybody,. Our Data Team is composed by two of us. There's a Data Scientist and me, as a DE. We created a Data Lakehouse for our company internal use and client data supply, but currently the Data Scientist is currently more focused on AI and agents integration and I'm doing...

Redditr/apachekafka · u/MiserableBerry4138Sep 19

After 10 years working with Kafka, I built the data tool I wanted

...testing, investigations, or team workshops. AI assistance is also available when I need help building a filter.. I have also put a lot of effort into preserving context. I can investigate something in UAT, switch to Dev, and later return with my selected topic, results, filter,...

GitHub issuesairbytehq/airbyte · ardalan-jalalSep 15

[source-mongodb-v2] CDC authentication can require credentials in connection string and expose them in logs/state

### Connector Name `source-mongodb-v2` ### Connector Version `2.0.7` ### What step the error happened? During the sync ### Relevant information # 🐛 [source-mongodb-v2] CDC authentication can expose credentials in logs/state ## 🔌 Connector Information | Field | Value |...

GitHub issuesairbytehq/airbyte · SkinnyPigeonSep 9

NPE in `MySqlGtidSet.UUIDSet.subtract` after RDS Blue/Green cutover (Debezium null-safety bug shipped in 3.53.x)

...in the Airbyte source is otherwise correct - it just has no way to defend itself when the underlying Debezium subtract NPEs. ## Impact - Every MySQL CDC connection against the migrated cluster fails identically. - The only "official" recovery is a full connection reset, which...

Companies and products named

2 posts
2 posts
2 posts
2 posts
1 post
1 post
About this problem

Evidence

8 posts from 8 people in 6 places, about 1 a week over 52 days. Mostly on airbytehq/airbyte, openai/codex, r/SQL. Tools named alongside: Airbyte, dbt, Codex, ChatGPT.

Frustration Frustration 0 of 3· Seen on GitHub issues, Reddit

How it was grouped

Posts that state a pain and match the "ingestion" rule. First post Sep 9, 2026, latest Oct 30, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

The same problem elsewhere

PostgreSQL connectors and syncs are fragile

4 posts from 4 people on GitHub issues, Hacker News.

MySQL connectors and syncs are fragile

4 posts from 4 people on GitHub issues.

Apache Iceberg connectors and syncs are fragile

3 posts from 3 people on GitHub issues.

SQL Server connectors and syncs are fragile

2 posts from 2 people on GitHub issues. Unverified.

Apache Flink connectors and syncs are fragile

2 posts from 2 people on GitHub issues. Unverified.

History

Momentum went from steady to fading.

Nov 4, 2026

Momentum went from fading to steady.

Oct 31, 2026

Momentum went from steady to fading.

Oct 29, 2026

Momentum went from fading to steady.

Oct 22, 2026

Momentum went from steady to fading.

Oct 21, 2026

Momentum went from fading to steady.

Oct 15, 2026

First seen with 3 posts.

Sep 25, 2026