Data and AI struggles

2,149 problems · 379 companies

Data engineering

Trouble with Apache Iceberg partition

4 posts from 4 people4d activeRising, +2 this week

Posts per day

Posts per day4 posts, Sep 1 to Nov 22

The posts behind it

GitHub issuesapache/iceberg · Anurag-S1nghNov 21

Truncate projection does not include the wrapped partition at the type minimum

### What happens `ProjectionUtil.truncateInteger` and `truncateLong` project ` ` without accounting for the wrapped partition that `TruncateUtil.truncateInt` and `truncateLong` produce at the type minimum. With `truncate[1000]` on an int column, values from -2147483648 to...

1 replies
GitHub issuesapache/iceberg · Shahzeb-DataEngineerNov 16

bucket(decimal) partition pruning silently drops rows when the query literal's scale differs from the column scale

### Apache Iceberg version None ### Query engine None ### Please describe the bug 🐞 ## Description With a `decimal(9,2)` column partitioned by `bucket(value, 16)`, the query `WHERE value = 100.0` silently misses rows holding `100.00`, because the literal keeps its written scale...

GitHub issuesClickHouse/ClickHouse · DimensionWieldrOct 15

Iceberg DROP PARTITION aborts or republishes parent delete counters after an overwrite snapshot

### Describe what's wrong `ALTER TABLE ... DROP PARTITION` on an Iceberg table builds the new snapshot summary by copying every unrecognized field from the parent summary, then writing this commit's own delete counters. For a parent snapshot whose `operation` is `overwrite`,...

1 reactions1 replies
GitHub issuesapache/iceberg · jackMintaoSep 1

Bug: Incremental partition stats compute produces collapsed/negative rows after partition spec evolution

### Apache Iceberg version 1.10.0 ### Query engine None ### Please describe the bug 🐞 ### Apache Iceberg version 1.10.0, 1.11.0 (latest as of filing; still present on `main`) ### Latest installation method and version Maven / Gradle build from source (`main`), also verified on...

1 reactions1 replies

Companies and products named

About this problem

Evidence

4 posts from 4 people in 2 places, about 1 a week over 82 days. Mostly on apache/iceberg, ClickHouse/ClickHouse. Tools named alongside: ClickHouse, GitHub.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts about Apache Iceberg with no known issue, sharing the word "partition". First post Sep 1, 2026, latest Nov 21, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

Other Apache Iceberg problems

Apache Iceberg upgrades break working setups

9 posts from 8 people on GitHub issues.

Apache Iceberg users keep filing bugs

Top post: "VARIANT does not work with older <= 4.1 HMS versions", one of 11 posts from 10 people on GitHub issues, Reddit.

Trouble with Apache Iceberg table

Top post: "Iceberg: `CREATE TABLE` writes a non-standard `required` key inside `list` types, breaking the engine after", one of 15 posts from 10 people on GitHub issues.

Trouble with Apache Iceberg spark

Top post: "Spark: WAP snapshot isolation broken for format-version 3 tables when deletion vectors are used (spark.wap.id)", one of 6 posts from 6 people on GitHub issues.

Trouble with Apache Iceberg rest

Top post: "Core: Negative delete-file-references in REST scan response cause IndexOutOfBoundsException", one of 6 posts from 5 people on GitHub issues, Reddit.

Apache Iceberg runs out of memory

4 posts from 3 people on GitHub issues.

Trouble with Apache Iceberg rows

Top post: "Parquet TIMESTAMP_MILLIS stats pruning can drop matching rows", one of 3 posts from 3 people on GitHub issues.

Trouble with Apache Iceberg core

Top post: "Core: RewriteManifests.addManifest mishandles v1-format manifests on v2+ tables", one of 3 posts from 3 people on GitHub issues.

Apache Iceberg schema changes break downstream pipelines

3 posts from 3 people on GitHub issues.

Apache Iceberg connectors and syncs are fragile

3 posts from 3 people on GitHub issues.

Bad data slips through Apache Iceberg unnoticed

3 posts from 3 people on GitHub issues.

History

Corroborated: 3 or more posts from 2 or more people or places.

Nov 22, 2026

Momentum went from fading to rising.

Nov 22, 2026

First seen with 1 post; the top post now: "Iceberg DROP PARTITION aborts or republishes parent delete counters after an overwrite snapshot".

Nov 2, 2026