Data and AI struggles

1,730 problems · 342 companies

Data engineering

ClickHouse schema changes break downstream pipelines

2 posts from 1 person2d activeFading, +0 this weekunverified

Posts per day

Posts per day2 posts, Oct 12 to Nov 9

The posts behind it

GitHub issuesClickHouse/ClickHouse · clickgapaiNov 2

Iceberg filter on a reused column name prunes old files by wrong column

### Describe what's wrong - Filtering on a column whose name was reused by schema evolution silently drops rows from old data files. - Trigger: drop a column, rename another column onto the dropped name, then query that name with `WHERE`. - `SELECT *` returns rows correctly, but...

GitHub issuesClickHouse/ClickHouse · clickgapaiOct 12

Column `ALTER` during unregistered `ALTER UPDATE` leaves mutation queue stuck

...then `RENAME COLUMN v TO w`. - The `UPDATE` should apply or be refused; instead it keeps failing with `NO_SUCH_COLUMN_IN_TABLE` and the `RENAME` mutation never finishes. - With default `alter_sync` the `RENAME` hangs holding the alter lock, so later `ALTER`s fail with...

Companies and products named

2 posts
2 posts
About this problem

Evidence

2 posts from 1 person in 1 place, about 1 a week over 22 days. Mostly on ClickHouse/ClickHouse. Tools named alongside: GitHub.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "schema-drift" rule about ClickHouse. First post Oct 12, 2026, latest Nov 2, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Upstream schema changes break downstream pipelines

6 posts from 6 people on GitHub issues, Reddit.

Apache Iceberg schema changes break downstream pipelines

3 posts from 3 people on GitHub issues.

Databricks schema changes break downstream pipelines

3 posts from 3 people on GitHub issues, Reddit.

Airbyte schema changes break downstream pipelines

2 posts from 2 people on GitHub issues. Unverified.

DuckDB schema changes break downstream pipelines

2 posts from 2 people on GitHub issues. Unverified.

Apache Flink schema changes break downstream pipelines

2 posts from 2 people on GitHub issues. Unverified.

Other ClickHouse problems

ClickHouse upgrades break working setups

31 posts from 20 people on GitHub issues.

ClickHouse users keep filing bugs

Top post: "Tighten seccomp policy for optional kernel interfaces", one of 19 posts from 8 people on GitHub issues.

Trouble with ClickHouse column

Top post: "MaterializedPostgreSQL: reading a Nullable column's .null subcolumn (x IS NULL, count(x)) fails with", one of 15 posts from 9 people on GitHub issues.

ClickHouse costs outgrow the value it gives

11 posts from 3 people on GitHub issues.

Trouble with ClickHouse table

Top post: "`SYSTEM RESTORE REPLICA` on a second replica over-bumps the table `metadata` znode version; every later", one of 8 posts from 5 people on GitHub issues.

Experiments on ClickHouse are hard to reproduce and track

8 posts from 1 person on GitHub issues. Unverified.

Trouble with ClickHouse tables

Top post: "Paimon: resolve columns by field id, so tables with renamed or re-added columns are readable", one of 7 posts from 6 people on GitHub issues.

Trouble with ClickHouse join

Top post: "Explicit grace_hash now spills at max_bytes_ratio_before_external_join = 0.5 although the build side fits in", one of 5 posts from 4 people on GitHub issues.

ClickHouse error messages are cryptic

5 posts from 3 people on GitHub issues.

Trouble with ClickHouse read

Top post: "ORC: a corrupt PostScript `metadata_length` makes ORC predicate pushdown read `stripe_stats` out of bounds,", one of 4 posts from 4 people on GitHub issues.

Trouble with ClickHouse database

Top post: "`DROP NAMED COLLECTION` succeeds while a database uses the collection, and the server then fails to start", one of 4 posts from 2 people on GitHub issues.

Trouble with ClickHouse query

Top post: "Memory tracker counts jemalloc's freed pages as used, so a heavy query started right after another spills to", one of 4 posts from 3 people on GitHub issues.

History

Momentum went from steady to fading.

Nov 9, 2026

First seen with 2 posts.

Nov 6, 2026