Data and AI struggles

1,512 problems · 320 companies

Data engineering

Apache Flink connectors and syncs are fragile

2 posts from 2 people2d activeSteady, +1 this weekunverified

Posts per day

Posts per day2 posts, Oct 22 to Nov 3

The posts behind it

GitHub issuesapache/iceberg · jiwen624Nov 2

Flink: Upserts and deletes after a partition spec change leave duplicate and deleted rows in the table

...bug 🐞 After a table's partition spec changes, Flink upsert and CDC writes can silently fail to update or delete rows written before the change: - An upsert of an existing key leaves both the old and the new version in the table, so the primary key is duplicated. - A CDC delete...

1 replies
GitHub issuesapache/iceberg · yhyyzOct 22

Flink: ConvertEqualityDeletes fails with ClassCastException when equality fields contain a DATE column

### Apache Iceberg version 1.12.0 (latest release) ### Query engine Flink ### Please describe the bug 🐞 ### Summary The Flink `ConvertEqualityDeletes` maintenance task (added in 1.12.0) fails on every conversion cycle when the equality field columns include a `DATE` column. No...

Companies and products named

About this problem

Evidence

2 posts from 2 people in 1 place, about 1 a week over 12 days. Mostly on apache/iceberg. Tools named alongside: Apache Iceberg, GitHub.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "ingestion" rule about Apache Flink. First post Oct 22, 2026, latest Nov 2, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Ingestion connectors and CDC are fragile

7 posts from 7 people on GitHub issues, Reddit.

PostgreSQL connectors and syncs are fragile

4 posts from 4 people on GitHub issues, Hacker News.

MySQL connectors and syncs are fragile

4 posts from 4 people on GitHub issues.

Apache Iceberg connectors and syncs are fragile

3 posts from 3 people on GitHub issues.

SQL Server connectors and syncs are fragile

2 posts from 2 people on GitHub issues. Unverified.

Other Apache Flink problems

Apache Flink users keep filing bugs

Top post: "Clarify that write.*.isolation-level properties do not apply to append/INSERT", one of 5 posts from 5 people on GitHub issues, Reddit, Stack Overflow.

Trouble with Apache Flink column

Top post: "A dropped field is rejected as Cannot drop clustering column when a clustering column under another parent", one of 3 posts from 3 people on GitHub issues.

Apache Flink upgrades break working setups

3 posts from 3 people on GitHub issues.

Apache Flink tables suffer from small files and skew

2 posts from 2 people on GitHub issues. Unverified.

Trouble with Apache Flink columns

Top post: "`VACUUM ... USING INVENTORY` rejects tables with non-nullable columns and comments", one of 2 posts from 2 people on GitHub issues. Unverified.

Apache Flink schema changes break downstream pipelines

2 posts from 2 people on GitHub issues. Unverified.

Trouble with Apache Flink spark

One post on GitHub issues: "DeltaSqlParser does not override parsePlanWithParameters, so SQL parameter markers are dropped". Unverified.

History

First seen with 2 posts.

Nov 3, 2026