Data and AI struggles

1,730 problems · 342 companies

MLOps

Trouble with vLLM drops

2 posts from 2 people2d activeSteady, +1 this weekunverified

Posts per day

Posts per day2 posts, Oct 7 to Nov 9

The posts behind it

GitHub issuesvllm-project/vllm · davrens101Nov 6

[Bug]: xLAM non-streaming tool parser drops single tool call object in <tool_call> tags

### Describe the bug In `xLAMToolParser.extract_tool_calls`, the JSON extracted by `preprocess_model_output` is strictly required to be a list: However, when a model produces a single tool call enclosed in ` ` XML tags: The streaming parser (`extract_tool_calls_streaming`)...

GitHub issuesvllm-project/vllm · the-ShallowOct 7

[Bug]: tool_choice="required"` streaming drops tool calls when one delta completes more than one call

### Your current environment The output of python collect_env.py ### 🐛 Describe the bug With `tool_choice="required"` the model writes a JSON array of tool calls, and the serving layer streams it through `extract_required_tool_call_streaming` (`vllm/tool_parsers/streaming.py`)....

2 replies

Companies and products named

2 posts
About this problem

Evidence

2 posts from 2 people in 1 place, about 1 a week over 31 days. Mostly on vllm-project/vllm.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts about vLLM with no known issue, sharing the word "drops". First post Oct 7, 2026, latest Nov 6, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

Other vLLM problems

Running vLLM locally hits memory and speed limits

21 posts from 20 people on GitHub issues, Reddit.

Trouble with vLLM draft

Top post: "Draft model construction resets data_parallel_index to 0 (load_draft_model / create_draft_parallel_config),", one of 3 posts from 3 people on GitHub issues.

vLLM users keep filing bugs

Top post: "Qwen3.8-flash-next 0% MTP acceptance rate in disaggregated PD serving", one of 34 posts from 31 people on GitHub issues, Reddit.

vLLM upgrades break working setups

17 posts from 17 people on GitHub issues.

vLLM vulnerabilities are hard to triage and patch

9 posts from 9 people on Glyph Ibis.

vLLM runs out of context on real work

5 posts from 5 people on GitHub issues.

vLLM GPU access and drivers are painful

5 posts from 3 people on GitHub issues.

Fine-tuning vLLM is costly and unpredictable

4 posts from 4 people on GitHub issues.

Trouble with vLLM cache

Top post: "AOT compile cache never loads for Qwen3.5 models: Kernel index 1 not found in id_to_kernel", one of 4 posts from 4 people on GitHub issues.

Trouble with vLLM kernel

Top post: "ROCM_AITER_MLA can select an aiter MLA decode kernel that silently returns uncorrelated output (gqa_ratio=16,", one of 3 posts from 3 people on GitHub issues.

Trouble with vLLM size

Top post: "EPLB counts load for the wrong expert when step_interval < window_size", one of 3 posts from 3 people on GitHub issues.

vLLM runs out of memory

3 posts from 3 people on GitHub issues.

History

First seen with 2 posts; the top post now: "tool_choice=required` streaming drops tool calls when one delta completes more than one call".

Nov 7, 2026