Data and AI struggles

1,730 problems · 342 companies

MLOps

Trouble with vLLM rocm

2 posts from 2 people2d activeFading, +0 this weekunverified

Posts per day

Posts per day2 posts, Aug 27 to Nov 9

The posts behind it

GitHub issuesvllm-project/vllm · jamesETsmithSep 24

[ROCm][Perf][Tracking Issue]: Hy4-Preview

### 🚀 The feature, motivation and pitch This issue is intended as a parent ticket for all work enabling and optimizing Hy4-Preview on ROCm hardware. # Enablement - [not merged] https://github.com/vllm-project/vllm/pull/54432 - [not merged]...

1 reactions1 replies
GitHub issuesvllm-project/vllm · simondanielssonAug 27

[Bug]: torch profiler hangs on ROCm after rocprofiler-sdk 1.3.2 bump

### Your current environment The output of python collect_env.py ### 🐛 Describe the bug Starting the torch profiler after #53182 **causes the engine to hang indefinitely**, spinning on rocprofiler-sdk's queue interposition. ### Short term fix Setting...

1 reactions5 replies

Companies and products named

2 posts
2 posts
About this problem

Evidence

2 posts from 2 people in 1 place, about 1 a week over 29 days. Mostly on vllm-project/vllm. Tools named alongside: GitHub.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts about vLLM with no known issue, sharing the word "rocm". First post Aug 27, 2026, latest Sep 24, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

Other vLLM problems

Running vLLM locally hits memory and speed limits

21 posts from 20 people on GitHub issues, Reddit.

Trouble with vLLM draft

Top post: "Draft model construction resets data_parallel_index to 0 (load_draft_model / create_draft_parallel_config),", one of 3 posts from 3 people on GitHub issues.

vLLM users keep filing bugs

Top post: "Qwen3.8-flash-next 0% MTP acceptance rate in disaggregated PD serving", one of 34 posts from 31 people on GitHub issues, Reddit.

vLLM upgrades break working setups

17 posts from 17 people on GitHub issues.

vLLM vulnerabilities are hard to triage and patch

9 posts from 9 people on Glyph Ibis.

vLLM runs out of context on real work

5 posts from 5 people on GitHub issues.

vLLM GPU access and drivers are painful

5 posts from 3 people on GitHub issues.

Fine-tuning vLLM is costly and unpredictable

4 posts from 4 people on GitHub issues.

Trouble with vLLM cache

Top post: "AOT compile cache never loads for Qwen3.5 models: Kernel index 1 not found in id_to_kernel", one of 4 posts from 4 people on GitHub issues.

Trouble with vLLM kernel

Top post: "ROCM_AITER_MLA can select an aiter MLA decode kernel that silently returns uncorrelated output (gqa_ratio=16,", one of 3 posts from 3 people on GitHub issues.

Trouble with vLLM size

Top post: "EPLB counts load for the wrong expert when step_interval < window_size", one of 3 posts from 3 people on GitHub issues.

vLLM runs out of memory

3 posts from 3 people on GitHub issues.

History

First seen with 2 posts; the top post now: "torch profiler hangs on ROCm after rocprofiler-sdk 1.3.2 bump".

Nov 7, 2026