Problemsby GlyphQwen users keep filing bugs
19 posts from 19 people16d activeFading, +1 this week
Posts per day
The posts behind it
[Bug]: Draft-model speculative decoding exceeds the token budget during warmup
...token-budget and sequence-limit flags above explicitly specify the values used in the failing run. Relevant traceback: ## Root Cause Analysis In `vllm/v1/worker/gpu/warmup.py`, `_warmup_kernels` sizes the batch without accounting for the draft model’s extra slot per request:...
[RFC]: Selected input-row hidden-state export for full-vocabulary OPD teachers
## Motivation [Design decisions and verified measurements](https://github.com/vllm-project/vllm/issues/65056#issuecomment-6602921312). **Coordination update, 2026-11-03.** #57736 at `dfc9982` now implements absolute input-row capture for OPD teachers, bounded prefix hits, HTTP...
SDPA launch failures on ROCm Windows surface as misleading async errors with no fallback — propose error translation or startup probe
...re-raise with a hint: "a fused SDPA backend (flash/mem-efficient) may be failing on this build; try `torch.nn.attention.sdpa_kernel(SDPBackend.MATH)` or disable the failing backend". One helper + one catch-site per integration (`transformers/integrations/sdpa_attention.py`,...
[Bug]: video/jpeg frames_indices rejected when more frames than num_frames are sent
### Your current environment - vLLM main `274a5e19a` (precompiled wheel), Python 3.12.16, torch 2.14.0+cu130, transformers 5.20.2 - 1x NVIDIA H200 NVL (driver 615.71.09) for the server check; the minimal repro below runs on CPU ### 🐛 Describe the bug Sending pre-extracted...
Using Gemma/Qwen/LiquidAi models for gmail/calendar access.
...and then tried Gemma e4b,26bmoe, 12b, qwen models and even liquid ai models. All them fail to connect and retrieve calendar events. I tried telling where the client secret is save so they can authenticate again. Tried telling them about Google workspace skill, installed gws but...
Get ready for qwen4
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
mlxrunner: fused linear-attention kernels skip float16 activations
### What is the issue? Two fused kernels run in every linear-attention layer of Qwen 3.5, Qwen3-Next and qwen4_exp: the causal conv with SiLU, then the gated delta. Both are generic over the input dtype, but their dispatch accepts only bfloat16 (the conv also takes float32). A...
Need help for thinking issue on my Model
This quite a difficult issue and I quite literally exhuated all my options so I'm posting on here (which is something I never do lol). Basically, I am locally running a Qwen model that basically always thinks for like a whole minute before answering (even to questions like how...
Automation and AI
...with 128 GB and I’m running a 27B Qwen 3.8 from Unsloth, which I use with Pi and OWUI.. Any suggestions?. I can’t use online tools for privacy reasons.. What would you use for automation?. .
Open sourcing Game Summoner, my prompt to game site
...We return any exceptions and inputs that do nothing (the model has notoriously been AWFUL at "is this good"...), and once there are none, we say "complete" and return to the user. . There are a couple other repos that are necessary:...
Request for good models on the cloud like Qwen 3.8 flash next , mimo v2.6 , hy4 , stepfun , laguna , refelction ai etc etc
@rick-github and others , I am an ollama pro user and have to rely so much on deepseek v4.1 flash for better limits which is just an okayish model , not as good gpt 6 luna or something like that which begs for more variety . I have raised this issue on github so many times in...
The best pretrained "decision" model for your real-time AI application - a benchmark
...with Typesafe’s Jev, the median distance was 540 m, with a best run of 1,417 m.. The bottleneck appeared to be the 200+ ms round trip. Around 1,500 metres, the game was moving too quickly for those responses to remain useful.. At the maximum speed, 200 ms means the runner...
MLX runner not using full GPU (Mac / M4 Pro)
### What is the issue? Model: Qwen 3.8 qwen3.8:27b-mxfp8 464021588235 CPU/GPU/RAM: M4 Pro 48GB OS: 15.8 Teted with Ollama 0.40.0 (on the left) vs. Ollama 0.35.1-rc2 (on the right): Notice how the GPU usage is hovering around 50-70%. Ollama ps shows this: Expected results: With...
My Qwen sales agent won't stay on script - sends wrong info and payment details too early. How do I enforce sales-flow adherence?
Dual GPU configuration report
I have a dual-GPU machine (5070ti and 5060ti), with 16GB each (32 total). Here are some notes: - Magnitude today reports *4* GPUs at startup, listing each GPU twice. I have two monitors, not sure if this is related. - It reports that models >8GB or so are too big to run. I often...
Using uncensored models makes working less of a headache
I have a lot of projects with my friends and team at work that I copy to use for my personal projects, whether it's a plugin I borrow with their consent or a script. I always find that Qwen 3.8 and Muse Spark 1.3 straight up refuse to do anything, as they see it as a steal, so I...
Qwen FN vs 27B --- Think I'm saturated.
...an interesting result, and I guess maybe I should have expected it because I was really struggling already to find things that I actually need to do day to day professionally that 27B couldn't do. When I escalate to the cloud now it's nearly always for either speed or context,...
DynamicCache(offloading=True) returns wrong logits after first cache reuse on hybrid Gated-DeltaNet + attention models (e.g. Qwen3.8-27B)
...not isolated which specific tensor (recurrent state vs conv state vs something else) fails to round-trip through CPU offload for this layer type, since I don't have bandwidth to go deeper right now - flagging with a minimal, exact repro in case it's useful, and happy to help...
Qwen3.8-Flash-Next optimizations tracking issue
Optimizations for Qwen/Qwen3.8-Flash-Next ## Kernels [#55272：Remove torch.compile for NVIDIA implementation](https://github.com/vllm-project/vllm/pull/55272) [#54517：Fuse Qwen4Exp PLE kernels](https://github.com/vllm-project/vllm/pull/54517) [#54513：Separate prefill and decode...
Companies and products named
About this problem
Evidence
19 posts from 19 people in 10 places, about 2 a week over 59 days. Mostly on vllm-project/vllm, r/LocalLLaMA, ollama/ollama. Tools named alongside: vLLM, GitHub, Ollama, NVIDIA.
Frustration Frustration 1 of 3· Seen on GitHub issues, Reddit, Community forums
How it was grouped
Posts about Qwen that state a pain but match no known issue yet. First post Sep 8, 2026, latest Nov 5, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
Other Qwen problems
Running Qwen locally hits memory and speed limits
18 posts from 18 people on GitHub issues, Reddit, Stack Overflow.
Qwen upgrades break working setups
5 posts from 5 people on GitHub issues.
Fine-tuning Qwen is costly and unpredictable
4 posts from 4 people on GitHub issues, Hacker News, Reddit.
Trouble with Qwen local
Top post: "Feature request: Local image-generation model support with hardware-tuned inference", one of 3 posts from 3 people on Reddit, Stack Overflow, GitHub issues.
Qwen rate limits and usage caps block work
2 posts from 2 people on Reddit, GitHub issues. Unverified.
Qwen runs out of context on real work
2 posts from 2 people on Reddit, GitHub issues. Unverified.
Qwen fails to return valid structured output
2 posts from 2 people on GitHub issues. Unverified.
History