Data and AI struggles

2,114 problems · 377 companies

Data engineering

vLLM streams lag, drop or reorder events

2 posts from 1 person2d activeFading, +0 this weekunverified

Posts per day

Posts per day2 posts, Nov 6 to Nov 21

The posts behind it

GitHub issuesvllm-project/vllm · latioswangNov 11

[RFC]: Async EPLB: one owner for all state, worker runs self-contained jobs

### Motivation. **One owner for all async EPLB state: the main thread. The worker thread only runs self-contained jobs.** Today the main thread and the async EPLB worker hand work to each other through seven pieces of shared mutable state. Fault recovery has to patch that state...

GitHub issuesvllm-project/vllm · latioswangNov 6

[Bug]: With --enable-fault-tolerance, an async EPLB worker exception stalls EPLB silently instead of making the engine UNHEALTHY

...FT. So `_all_ranks_result_ready()` never raises (`eplb_state.py:1087-1103`). 3. The failing rank never publishes `pending_result` for its current layer, so: - every rank's readiness all-reduce returns False on every step; - `rebalanced` stays True; - `step()` keeps taking the...

1 replies

Companies and products named

2 posts
About this problem

Evidence

2 posts from 1 person in 1 place, about 2 a week over 6 days. Mostly on vllm-project/vllm.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "streaming" rule about vLLM. First post Nov 6, 2026, latest Nov 11, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Streaming pipelines lag, drop or reorder events

15 posts from 15 people on GitHub issues, Stack Overflow.

Apache Kafka streams lag, drop or reorder events

3 posts from 3 people on Reddit, Mastodon.

ClickHouse streams lag, drop or reorder events

2 posts from 2 people on GitHub issues, Reddit. Unverified.

Other vLLM problems

vLLM users keep filing bugs

Top post: "Qwen3.8-flash-next 0% MTP acceptance rate in disaggregated PD serving", one of 37 posts from 34 people on GitHub issues, Reddit.

Running vLLM locally hits memory and speed limits

27 posts from 26 people on GitHub issues, Reddit.

vLLM upgrades break working setups

21 posts from 21 people on GitHub issues.

vLLM vulnerabilities are hard to triage and patch

9 posts from 9 people on Glyph Ibis.

vLLM runs out of context on real work

7 posts from 7 people on GitHub issues.

Trouble with vLLM cache

Top post: "AOT compile cache never loads for Qwen3.5 models: Kernel index 1 not found in id_to_kernel", one of 7 posts from 6 people on GitHub issues.

Fine-tuning vLLM is costly and unpredictable

7 posts from 7 people on GitHub issues.

vLLM GPU access and drivers are painful

5 posts from 3 people on GitHub issues.

vLLM fails to return valid structured output

5 posts from 5 people on GitHub issues.

Trouble with vLLM serve

Top post: "gpt-oss can't be served through `vllm serve` with any tool/reasoning-parser flags", one of 4 posts from 4 people on GitHub issues.

Trouble with vLLM performance

Top post: "Waiting requests re-walk their whole prefix-cache hit on every scheduling step", one of 3 posts from 3 people on GitHub issues, Reddit.

vLLM lock-in makes switching costly

3 posts from 3 people on GitHub issues.

History

Momentum went from steady to fading.

Nov 18, 2026

First seen with 2 posts.

Nov 17, 2026