Problemsby GlyphApache Kafka users keep asking for help
11 posts from 11 people10d activeFading, +0 this week
Posts per day
The posts behind it
Apache Kafka 4.4.0 is out!
...* Dead-letter queues for share groups: Makes it easier to deal with records that keep failing.. https://issues.apache.org/jira/browse/KAFKA-19469 . * Rack-aware producer partitioning: Helps producers make better partitioning decisions based on rack location.....
BBRmap: A Kafka TCO tool that includes setup and ongoing engineering costs, not just vendor bills.
...required for setup and ongoing operations. The usage, infra needs and engineering work are broken down into components so you can inspect them and, if needed, overwrite them in the future production version. The rates for cloud infrastructure and managed software are currently...
How to reference a file inside the current jar to be loaded in a library
I am currently trying to write a job for Apache Flink that accesses a Kafka data stream which is hosted with a ssl service using a private certificate with my own CA and the common solution to support that is to load a truststore JKS file (or a pkcs12 file) by setting a property...
Kafka: Filter empty strings and whitespace in IcebergSinkConfig stringToList
### Apache Iceberg version 1.12.0 (latest release) ### Query engine None ### Please describe the bug 🐞 ### Problem `IcebergSinkConfig.stringToList()` previously only checked for `value == null || value.isEmpty()`. When provided with whitespace-only strings, consecutive...
Kafka partition can stay paused: resume_partitions dropped right after assign
### Describe what's wrong - A partition `initializeQueues` paused when it left a consumer can stay paused when it returns. - Trigger is `KeeperHandlingConsumer::prepareToPoll` calling `rollbackToCommittedOffsets` then `updateOffsets`, which calls `assign` then...
Will custom restart logic using setUncaughtExceptionHandler properly recover a Kafka Streams application from all errors?
I am attempting to write a retry mechanism for my Kotlin Kafka Streams microservice to recover from stream errors.. Questions: Will this restart pattern work for all types of Kafka Streams errors (e.g., transient network errors, broker disconnections, deserialization issues, or...
rekaf - a small Bash script for Kafka topics and ACLs
...English and Russian:. https://github.com/Thoroughly-Pizzled-Studio/rekaf . If you spot a problem with the ACL checks or have a case the script handles badly, I’d like to hear about it.. Disclosure: AI also helped me write this post in English..
Spring Kafka: Topic <topicName> not present in metadata after 60000ms
This is the 2nd time I have observed that my Spring Boot 4 application has an error while sending a message to Kafka topic. Where it happened: Production (Kafka broker managed by Confluent). Exact error message: org.apache.kafka.common.errors.TimeoutException: Topic <topicName>...
RCK tests fail to bind port 8181 when run alongside the kafka-connect integration stack
### Apache Iceberg version main (development) ### Query engine Other ### Please describe the bug 🐞 `RESTCompatibilityKitCatalogTests` and `RESTCompatibilityKitViewCatalogTests` start their local `RESTCatalogServer` through `@ExtendWith(RESTServerExtension.class)`, which uses...
How to count messages in compact topic(Kafka)?
...the topic), but with compacted topics this way can be called an estimation at best.. So is there any way to precisely count messages for compacted topic relatively fast? (I see the only way with using polling, but it takes minutes, maybe there is any other ways to do it).
Enable Kafka coordinator fencing when committing consumer offsets
### Feature Request / Improvement ### Description Add support for coordinator fencing. This can prevent stale ("zombie") coordinators from committing stale consumer offsets. ### Implementation Currently, we generate a new UUID for every new coordinator. This means that the Kafka...
Companies and products named
About this problem
Evidence
11 posts from 11 people in 4 places, about 2 a week over 48 days. Mostly on Stack Overflow [apache-kafka], apache/iceberg, r/apachekafka. Tools named alongside: Apache Iceberg, GitHub, Confluent, Apache Flink.
Frustration Frustration 0 of 3· Seen on Stack Overflow, GitHub issues, Reddit
How it was grouped
Posts about Apache Kafka that state a pain but match no known issue yet. First post Sep 10, 2026, latest Oct 27, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
Other Apache Kafka problems
Trouble with Apache Kafka connect
Top post: "Kafka connect runtime 1.12.0 Azure Blob writes silently hang due to netty-tcnative/netty-handler", one of 3 posts from 3 people on GitHub issues.
Apache Kafka lock-in makes switching costly
2 posts from 2 people on Reddit, GitHub issues. Unverified.
Apache Kafka streams lag, drop or reorder events
2 posts from 2 people on Mastodon, Reddit. Unverified.
Apache Kafka tables suffer from small files and skew
2 posts from 2 people on GitHub issues, Reddit. Unverified.
History