Trouble with vLLM silently
2 posts from 2 people2d activeFading, +0 this weekunverified
Posts per day
The posts behind it
[Bug]: rotary_embedding silently miscomputes q/k with non-unit last-dimension stride
### Your current environment The output of python collect_env.py ### 🐛 Describe the bug ### Bug description `vllm._custom_ops.rotary_embedding` does not validate non-unit innermost strides in q/k. The wrapper passes the token stride and, for 3D inputs, the head stride to the...
AutoTokenizer with tokenizer_class=LlamaTokenizerFast silently builds a sentencepiece pipeline for a byte-level BPE tokenizer.json, dropping all CJK input
### System Info transformers: 5.8.1 tokenizers: 0.22.2 Python 3.10.12 platform: Linux x86_64, inside Docker ### Who can help? _No response_ ### Information - [ ] The official example scripts - [ ] My own modified scripts ### Tasks - [ ] An officially supported task in the...
Companies and products named
About this problem
Evidence
2 posts from 2 people in 2 places, about 1 a week over 43 days. Mostly on huggingface/transformers, vllm-project/vllm. Tools named alongside: Docker, Hugging Face, PyTorch, GitHub.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts about vLLM with no known issue, sharing the word "silently". First post Oct 2, 2026, latest Nov 13, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
Other vLLM problems
vLLM users keep filing bugs
Top post: "Qwen3.8-flash-next 0% MTP acceptance rate in disaggregated PD serving", one of 37 posts from 34 people on GitHub issues, Reddit.
Running vLLM locally hits memory and speed limits
27 posts from 26 people on GitHub issues, Reddit.
vLLM upgrades break working setups
21 posts from 21 people on GitHub issues.
vLLM vulnerabilities are hard to triage and patch
9 posts from 9 people on Glyph Ibis.
vLLM runs out of context on real work
7 posts from 7 people on GitHub issues.
Trouble with vLLM cache
Top post: "AOT compile cache never loads for Qwen3.5 models: Kernel index 1 not found in id_to_kernel", one of 7 posts from 6 people on GitHub issues.
Fine-tuning vLLM is costly and unpredictable
7 posts from 7 people on GitHub issues.
vLLM GPU access and drivers are painful
5 posts from 3 people on GitHub issues.
vLLM fails to return valid structured output
5 posts from 5 people on GitHub issues.
Trouble with vLLM serve
Top post: "gpt-oss can't be served through `vllm serve` with any tool/reasoning-parser flags", one of 4 posts from 4 people on GitHub issues.
Trouble with vLLM performance
Top post: "Waiting requests re-walk their whole prefix-cache hit on every scheduling step", one of 3 posts from 3 people on GitHub issues, Reddit.
vLLM lock-in makes switching costly
3 posts from 3 people on GitHub issues.
History