vLLM
Open source project80 problems281 posts+36 this week
Problem posts per week
vLLM problems
Running vLLM locally hits memory and speed limits
21 posts from 20 people on GitHub issues, Reddit.
Running NVIDIA locally hits memory and speed limits
16 posts from 16 people on GitHub issues.
SQLite upgrades break working setups
18 posts from 17 people on GitHub issues.
OpenAI users keep asking for help
Top post: "Multi-file uploads failing and ZIP archives not parsing / sandbox timeout (100% Limits Remaining)", one of 49 posts from 47 people on Community forums, GitHub issues, Reddit.
Running DeepSeek locally hits memory and speed limits
8 posts from 8 people on GitHub issues, Hacker News.
Trouble with vLLM draft
Top post: "Draft model construction resets data_parallel_index to 0 (load_draft_model / create_draft_parallel_config),", one of 3 posts from 3 people on GitHub issues.
Running Qwen locally hits memory and speed limits
18 posts from 18 people on GitHub issues, Reddit, Stack Overflow.
Running OpenAI locally hits memory and speed limits
13 posts from 13 people on GitHub issues.
NVIDIA GPU access and drivers are painful
12 posts from 12 people on GitHub issues, Mastodon, Reddit.
Running LLMs locally hits memory and speed limits
22 posts from 21 people on GitHub issues, Reddit, Hacker News.
Trouble with OpenAI calls
Top post: "Unable to connect to dot calls across mobile, web and desktop", one of 7 posts from 6 people on GitHub issues, Community forums.
DeepSeek users keep filing bugs
Top post: "DeepSeek-V4.1-Flash cannot run on SM120 (RTX PRO 6000): compressed-layer page_block_size=32 has no FlashInfer", one of 18 posts from 18 people on GitHub issues, Reddit.
vLLM users keep filing bugs
Top post: "Qwen3.8-flash-next 0% MTP acceptance rate in disaggregated PD serving", one of 34 posts from 31 people on GitHub issues, Reddit.
OpenAI upgrades break working setups
25 posts from 25 people on GitHub issues, Reddit, Community forums.
Login, SSO and OAuth flows break
24 posts from 24 people on GitHub issues, Reddit, App Store reviews.
Qwen users keep filing bugs
Top post: "Get ready for qwen4", one of 19 posts from 19 people on GitHub issues, Reddit, Community forums.
Fine-tuning is costly and results are unpredictable
12 posts from 12 people on Hacker News, Reddit, GitHub issues.
GPU access, drivers and CUDA versions are painful
7 posts from 7 people on GitHub issues, Reddit.
Running PyTorch locally hits memory and speed limits
5 posts from 5 people on GitHub issues, Hacker News.
Trouble with Claude chat
Top post: "Allow chat agents to read the exact name of the selected model", one of 5 posts from 5 people on GitHub issues, App Store reviews.
PyTorch lock-in makes switching costly
4 posts from 4 people on GitHub issues.
Trouble with vLLM kernel
Top post: "ROCM_AITER_MLA can select an aiter MLA decode kernel that silently returns uncorrelated output (gqa_ratio=16,", one of 3 posts from 3 people on GitHub issues.
Running Perplexity locally hits memory and speed limits
3 posts from 3 people on GitHub issues.
Trouble with OpenAI raises
Top post: "Whisper generate() raises 'You have modified the pretrained model configuration' since #48282", one of 3 posts from 3 people on GitHub issues.
Trouble with vLLM size
Top post: "EPLB counts load for the wrong expert when step_interval < window_size", one of 3 posts from 3 people on GitHub issues.
About
Problems here are about vLLM or name it. It is tracked from the product list on the Method page. Website: vllm.ai.