Data and AI struggles

2,114 problems · 377 companies

MLOps

Trouble with vLLM encoder

2 posts from 2 people2d activeFading, +0 this weekunverified

Posts per day

Posts per day2 posts, Sep 7 to Nov 21

The posts behind it

GitHub issuesvllm-project/vllm · jjbuckNov 12

[Bug]: With chunked prefill off and async scheduling, a multimodal request deferred for encoder limits can be overtaken by later image requests without limit

### Your current environment Output of python collect_env.py ### 🐛 Describe the bug With chunked prefill off and async scheduling, a multimodal request that doesn't fit in the encoder cache can wait indefinitely while requests with fewer images go ahead of it. Since #65399,...

2 replies
GitHub issuesvllm-project/vllm · jiaran-kingSep 7

[RFC][EPD] Avoid redundant encoder work when Prefill can reuse KV or embeddings

## Motivation In an E-first EPD deployment, Encoder work can start before the selected Prefill instance determines whether reusable KV or embeddings already satisfy the relevant multimodal input. This creates a potential mismatch between the work started on E and the work...

1 reactions5 replies

Companies and products named

2 posts
1 post
1 post
About this problem

Evidence

2 posts from 2 people in 1 place, about 1 a week over 67 days. Mostly on vllm-project/vllm. Tools named alongside: GitHub, NVIDIA.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts about vLLM with no known issue, sharing the word "encoder". First post Sep 7, 2026, latest Nov 12, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

Other vLLM problems

vLLM users keep filing bugs

Top post: "Qwen3.8-flash-next 0% MTP acceptance rate in disaggregated PD serving", one of 37 posts from 34 people on GitHub issues, Reddit.

Running vLLM locally hits memory and speed limits

27 posts from 26 people on GitHub issues, Reddit.

vLLM upgrades break working setups

21 posts from 21 people on GitHub issues.

vLLM vulnerabilities are hard to triage and patch

9 posts from 9 people on Glyph Ibis.

vLLM runs out of context on real work

7 posts from 7 people on GitHub issues.

Trouble with vLLM cache

Top post: "AOT compile cache never loads for Qwen3.5 models: Kernel index 1 not found in id_to_kernel", one of 7 posts from 6 people on GitHub issues.

Fine-tuning vLLM is costly and unpredictable

7 posts from 7 people on GitHub issues.

vLLM GPU access and drivers are painful

5 posts from 3 people on GitHub issues.

vLLM fails to return valid structured output

5 posts from 5 people on GitHub issues.

Trouble with vLLM serve

Top post: "gpt-oss can't be served through `vllm serve` with any tool/reasoning-parser flags", one of 4 posts from 4 people on GitHub issues.

Trouble with vLLM performance

Top post: "Waiting requests re-walk their whole prefix-cache hit on every scheduling step", one of 3 posts from 3 people on GitHub issues, Reddit.

vLLM lock-in makes switching costly

3 posts from 3 people on GitHub issues.

History

Momentum went from steady to fading.

Nov 19, 2026

First seen with 2 posts; the top post now: "Avoid redundant encoder work when Prefill can reuse KV or embeddings".

Nov 17, 2026