Data and AI struggles

1,348 problems · 309 companies

DevOps and infra

vLLM containers are slow, bloated or crash

2 posts from 2 people2d activeSteady, +1 this weekunverified

Posts per day

Posts per day2 posts, Sep 3 to Oct 29

The posts behind it

GitHub issueshuggingface/transformers · yidezouOct 28

Image preprocessing ~20% slower on Linux since v5.18.0: in-place normalize (#48897) causes extra page faults

### System Info - transformers 5.18.0 and 5.19.0 (regression); 5.17.0 is fine. `main` still has the change. - Linux x86_64 (glibc), Intel Xeon Platinum 8488C, Python 3.14 - torch 2.13.0+cpu, torchvision 0.28.0+cpu, Pillow 12.3.0 - 8 torch threads ### Who can help? @jzakrzew...

GitHub issuesvllm-project/vllm · hickeymaSep 3

[Feature]: Let `vllm launch render` / `--tokens-only` override an inherited `VLLM_ENABLE_SCALE_OUT_ENDPOINTS=0` instead of failing startup

### 🚀 The feature, motivation and pitch #54579 gated the scale-out endpoints behind `VLLM_ENABLE_SCALE_OUT_ENDPOINTS` and made an explicit `0` a hard startup error. Fail-closed is the right approach. A server that starts without any render routes would still pass its health...

1 reactions2 replies

Companies and products named

2 posts
1 post
About this problem

Evidence

2 posts from 2 people in 2 places, about 1 a week over 56 days. Mostly on vllm-project/vllm, huggingface/transformers. Tools named alongside: GitHub, Kubernetes, Hugging Face.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "containers" rule about vLLM. First post Sep 3, 2026, latest Oct 28, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Containers are slow to build, bloated or crash-looping

8 posts from 8 people on GitHub issues, Stack Overflow, Reddit.

Docker containers are slow, bloated or crash

2 posts from 2 people on GitHub issues, Mastodon. Unverified.

Other vLLM problems

Running vLLM locally hits memory and speed limits

13 posts from 13 people on GitHub issues, Reddit.

vLLM upgrades break working setups

17 posts from 17 people on GitHub issues.

Trouble with vLLM cache

Top post: "AOT compile cache never loads for Qwen3.5 models: Kernel index 1 not found in id_to_kernel", one of 4 posts from 4 people on GitHub issues.

vLLM runs out of context on real work

5 posts from 5 people on GitHub issues.

vLLM vulnerabilities are hard to triage and patch

3 posts from 3 people on Glyph Ibis.

vLLM users keep filing bugs

Top post: "Qwen3.8-flash-next 0% MTP acceptance rate in disaggregated PD serving", one of 44 posts from 40 people on GitHub issues, Reddit.

vLLM GPU access and drivers are painful

5 posts from 3 people on GitHub issues.

Trouble with vLLM performance

Top post: "Waiting requests re-walk their whole prefix-cache hit on every scheduling step", one of 3 posts from 3 people on GitHub issues, Reddit.

RAG on vLLM returns irrelevant or missing context

3 posts from 3 people on GitHub issues.

Trouble with vLLM installation

Top post: "v0.30.0 CPU wheels now require manylinux_2_39 (glibc 2.39), breaking installation on Ubuntu 22.04/Rhel9", one of 3 posts from 3 people on GitHub issues.

Trouble with vLLM decoding

Top post: "Support Qwen3.x MTP (Multi-Token Prediction) for speculative decoding", one of 3 posts from 3 people on GitHub issues.

Fine-tuning vLLM is costly and unpredictable

3 posts from 3 people on GitHub issues.

History

First seen with 2 posts.

Oct 29, 2026