Data and AI struggles

1,483 problems · 320 companies

Data engineering

ClickHouse streams lag, drop or reorder events

2 posts from 2 people2d activeFading, +0 this weekunverified

Posts per day

Posts per day2 posts, Oct 4 to Nov 2

The posts behind it

Redditr/apachekafka · u/shamus150Oct 23

Synchronising across multiple topics

We're struggling with exactly how to handle consuming data across three single topic partitions. The data is being written to a DB (ClickHouse in this case but not relevant). The data is produced by three separate producers who under normal conditions will write a 'set' of data...

GitHub issuesClickHouse/ClickHouse · wanteatfruitOct 4

`ARRAY JOIN` with a view boundary between fail with `TYPE_MISMATCH`

### Company or project name _No response_ ### Describe what's wrong A valid query fails to plan when three things meet: 1. A view's body has an `ARRAY JOIN`. `ARRAY JOIN [1] AS a` is enough, and it keeps every row exactly once. 2. A second `ARRAY JOIN` reads that view, either in...

1 replies

Companies and products named

About this problem

Evidence

2 posts from 2 people in 2 places, about 1 a week over 20 days. Mostly on ClickHouse/ClickHouse, r/apachekafka. Tools named alongside: Apache Kafka.

Frustration Frustration 0 of 3· Seen on GitHub issues, Reddit

How it was grouped

Posts that state a pain and match the "streaming" rule about ClickHouse. First post Oct 4, 2026, latest Oct 23, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Streaming pipelines lag, drop or reorder events

12 posts from 12 people on GitHub issues, Stack Overflow.

Apache Kafka streams lag, drop or reorder events

2 posts from 2 people on Mastodon, Reddit. Unverified.

Other ClickHouse problems

ClickHouse costs outgrow the value it gives

9 posts from 3 people on GitHub issues.

ClickHouse upgrades break working setups

23 posts from 14 people on GitHub issues.

Trouble with ClickHouse table

Top post: "`SYSTEM RESTORE REPLICA` on a second replica over-bumps the table `metadata` znode version; every later", one of 7 posts from 5 people on GitHub issues.

Experiments on ClickHouse are hard to reproduce and track

7 posts from 1 person on GitHub issues. Unverified.

Trouble with ClickHouse database

Top post: "`DROP NAMED COLLECTION` succeeds while a database uses the collection, and the server then fails to start", one of 6 posts from 2 people on GitHub issues.

ClickHouse error messages are cryptic

5 posts from 3 people on GitHub issues.

Trouble with ClickHouse read

Top post: "ORC: a corrupt PostScript `metadata_length` makes ORC predicate pushdown read `stripe_stats` out of bounds,", one of 4 posts from 4 people on GitHub issues.

Trouble with ClickHouse join

Top post: "Explicit grace_hash now spills at max_bytes_ratio_before_external_join = 0.5 although the build side fits in", one of 4 posts from 3 people on GitHub issues.

Trouble with ClickHouse merge

Top post: "GROUP BY over a near-unique key with ORDER BY count() DESC LIMIT n: bound group counts before counting them", one of 3 posts from 2 people on GitHub issues.

Trouble with ClickHouse name

Top post: "SIGSEGV reading a `7z` archive entry without a name", one of 3 posts from 2 people on GitHub issues.

ClickHouse rate limits and usage caps block work

3 posts from 3 people on GitHub issues.

Trouble with ClickHouse null

Top post: "Logical error: Sizes of nested column and null map of Nullable column are not equal after deserialization", one of 3 posts from 2 people on GitHub issues.

History

First seen with 2 posts.

Nov 2, 2026