Data and AI struggles

1,730 problems · 342 companies

Data engineering

Apache Flink users keep filing bugs

5 posts from 5 people5d activeFading, +0 this week

Posts per day

Posts per day5 posts, Aug 28 to Nov 9

The posts behind it

GitHub issuesapache/iceberg · namest504Nov 1

Core: `expireSnapshots()` inside a `Transaction` deletes files before `commitTransaction()` since 1.10.0

### Apache Iceberg version 1.12.0 (latest release). Also reproduced on 1.10.0. Not reproducible on 1.9.2. ### Query engine Other ### Please describe the bug When `expireSnapshots()` is used inside a `Transaction`, the expired manifest lists, manifests and data files are deleted...

GitHub issuesapache/iceberg · SergeyTimofeev1989Oct 22

Clarify that write.*.isolation-level properties do not apply to append/INSERT

...REST (Lakekeeper), S3 storage with remote signing. - The confusion is not about a missing feature - it is about the docs not making the append/row-level scoping of the `write.*.isolation-level` properties explicit.

2 replies
Stack OverflowStack Overflow [apache-flink] · Maya HazemOct 19

How should I design a Flink job that rebuilds a multi-join SQL view as a streaming result, and keep its state bounded?

I'm moving several batch SQL views to Flink 2.0 streaming jobs (Table API plus a few keyed process functions). Every input is a compacted upsert-kafka topic read from earliest. The jobs fall into two shapes:. Job A: main ⟕ extension ⟕ lookup_1 ⟕ lookup_2 ⟕ rates , filtered by a...

Redditr/dataengineering · u/Maleficent-Spell9654Sep 3

Decompressing Zip Files

...and flink don’t natively support regular zip files, and was wondering if anyone has any suggestions on how to handle this.. I am forced by requirements to use zip files, spark and flink, but i can consider adding additional technologies into the workflow if its better to just...

GitHub issuesapache/iceberg · talatuyarerAug 28

Flink: Support Iceberg Views

### Feature Request / Improvement Iceberg has a full view spec and `ViewCatalog` API (implemented by REST, Hive, JDBC, Nessie, and InMemory catalogs), and Spark + Trino already read and write Iceberg views - but the Flink connector has no view support today. I plan to implement...

1 replies

Companies and products named

About this problem

Evidence

5 posts from 5 people in 3 places, about 1 a week over 66 days. Mostly on apache/iceberg, r/dataengineering, Stack Overflow [apache-flink]. Tools named alongside: Apache Iceberg, Apache Kafka, Amazon S3, GitHub.

Frustration Frustration 0 of 3· Seen on GitHub issues, Reddit, Stack Overflow

How it was grouped

Posts about Apache Flink that state a pain but match no known issue yet. First post Aug 28, 2026, latest Nov 1, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

Other Apache Flink problems

Apache Flink upgrades break working setups

3 posts from 3 people on GitHub issues.

Trouble with Apache Flink column

Top post: "A dropped field is rejected as Cannot drop clustering column when a clustering column under another parent", one of 3 posts from 3 people on GitHub issues.

Apache Flink tables suffer from small files and skew

2 posts from 2 people on GitHub issues. Unverified.

Trouble with Apache Flink columns

Top post: "`VACUUM ... USING INVENTORY` rejects tables with non-nullable columns and comments", one of 2 posts from 2 people on GitHub issues. Unverified.

Apache Flink schema changes break downstream pipelines

2 posts from 2 people on GitHub issues. Unverified.

Apache Flink connectors and syncs are fragile

2 posts from 2 people on GitHub issues. Unverified.

Trouble with Apache Flink spark

One post on GitHub issues: "DeltaSqlParser does not override parsePlanWithParameters, so SQL parameter markers are dropped". Unverified.

History

Momentum went from steady to fading.

Nov 8, 2026

Renamed from "Apache Flink users keep asking for help".

Nov 3, 2026

Momentum went from fading to steady.

Nov 3, 2026

Momentum went from steady to fading.

Oct 29, 2026

Momentum went from rising to steady.

Oct 26, 2026

Momentum went from steady to rising.

Oct 25, 2026

Corroborated: 3 or more posts from 2 or more people or places.

Oct 21, 2026

Momentum went from fading to steady.

Oct 21, 2026

Renamed from "Apache Flink users keep filing bugs".

Oct 16, 2026

Back to unverified: fewer than 3 posts from 2 people or places.

Oct 16, 2026

Momentum went from steady to fading.

Oct 2, 2026

Momentum went from rising to steady.

Sep 28, 2026