DeepSeek fails to return valid structured output
2 posts from 2 people2d activeSteady, +1 this weekunverified
Posts per day
The posts behind it
[RFC]: Keep per-request token lists out of EngineCore garbage collection
### Motivation. Each `Request` in EngineCore holds its prompt twice as Python `list[int]`: `prompt_token_ids` and the copy `_all_token_ids`. CPython's cyclic GC visits every element of every tracked list, so each gen-0/gen-1 collection costs O(tokens of the requests that arrived...
[Bug]: DeepSeek V4.1 tool parser drops malformed DSML blocks and emits invalid/empty args on truncation
### Your current environment vLLM `0.31.0+g2107750` (a fork). `vllm/parser/deepseek_v4.py` and `vllm/parser/deepseek_v41.py` are byte-identical to upstream `main` as of 2026-10-16. Served with `--tool-call-parser deepseek_v41 --reasoning-parser deepseek_v41 --tokenizer-mode...
Companies and products named
About this problem
Evidence
2 posts from 2 people in 1 place, about 1 a week over 8 days. Mostly on vllm-project/vllm. Tools named alongside: vLLM, START, NVIDIA.
Frustration Frustration 3 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "structured-output" rule about DeepSeek. First post Oct 16, 2026, latest Oct 23, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
Models fail to return valid structured output
15 posts from 13 people on GitHub issues, Hacker News, Reddit.
Claude fails to return valid structured output
10 posts from 8 people on GitHub issues.
OpenAI fails to return valid structured output
9 posts from 9 people on GitHub issues, Hacker News.
Codex fails to return valid structured output
5 posts from 3 people on GitHub issues.
LlamaIndex fails to return valid structured output
5 posts from 5 people on GitHub issues.
Model Context Protocol fails to return valid structured output
5 posts from 5 people on GitHub issues, Reddit.
Ollama fails to return valid structured output
4 posts from 3 people on GitHub issues.
Anthropic fails to return valid structured output
3 posts from 3 people on GitHub issues.
Gemini fails to return valid structured output
3 posts from 3 people on GitHub issues, Reddit.
vLLM fails to return valid structured output
2 posts from 2 people on GitHub issues. Unverified.
Qwen fails to return valid structured output
2 posts from 2 people on GitHub issues. Unverified.
Mistral fails to return valid structured output
2 posts from 2 people on GitHub issues. Unverified.
Other DeepSeek problems
Running DeepSeek locally hits memory and speed limits
5 posts from 5 people on GitHub issues, Hacker News.
DeepSeek users keep filing bugs
Top post: "DeepSeek-V4.1-Flash cannot run on SM120 (RTX PRO 6000): compressed-layer page_block_size=32 has no FlashInfer", one of 15 posts from 15 people on GitHub issues, Reddit.
DeepSeek GPU access and drivers are painful
7 posts from 6 people on GitHub issues.
Trouble with DeepSeek cloud
Top post: "Request: Add cloud support for DeepSeek-V4.1-Flash", one of 5 posts from 5 people on GitHub issues.
Trouble with DeepSeek flash
Top post: "Asymmetric P/D Deployment for DeepSeek-V4.1 Flash", one of 3 posts from 3 people on GitHub issues, Community forums.
DeepSeek upgrades break working setups
2 posts from 2 people on GitHub issues. Unverified.
DeepSeek rate limits and usage caps block work
2 posts from 2 people on Hacker News, GitHub issues. Unverified.
DeepSeek lock-in makes switching costly
2 posts from 2 people on GitHub issues. Unverified.
History