llama.cpp upgrades break working setups
7 posts from 7 people7d activeFading, +0 this week
Posts per day
The posts behind it
Misc. bug: [Regression] Significant prefill performance drop on V100 (sm_70) in v1.0.0 compared to v0.8.0
...Meta() but Flash Attention over K/V rows is assigned to device CPU (usually due to missing support) W resolve_fused_ops: Flash Attention over K/V rows not supported, set to disabled I attempted to remove the -kvu (unified KV-cache) flag to see if it would resolve the issue....
Proposal: Investigate speculative decoding checkpoint initialization
**Status & Context:** Unverified hypothesis for investigation, not a confirmed upstream bug or fix proposal. Upstream issue [#29811](https://github.com/ggml-org/llama.cpp/issues/29811) discusses MTP startup assertion failures; a shared root cause has not been established....
vulkan: ~3x decode regression with spec decode + large -c on multi-device systems since e0bcacc
..."acceptance unchanged, throughput collapses" / crawling-spec signature): #30568, #30552. Workarounds today: `GGML_VK_VISIBLE_DEVICES= ` limited to the compute device, or revert of e0bcacc. Question: should the multi-device gpu-visible host-memory pool be skipped when a single...
v0.2.4 treats memory differently than v0.1.5, eliminating the ability to run larger models without closing all open apps
...the backend allows it, as llama.cpp did with `NoCopy` shared buffers on Apple Silicon. Failing that, offer an option for it. Either way, admission could then count file-backed weights as reclaimable.
Feature Request: gemma4 31B chat template quadratic scan cost
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
Feature Request: gracefully ignore missing/invalid arguments instead of failing the model loading in serve mode
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
server: streaming responses advertise Keep-Alive but the connection is closed after the stream, causing ReadError/RemoteProtocolError on pooled HTTP clients
...gaps (570 requests in one day, 7/283 vs 0/286). Under `strace` of llama-server, every failing request was on a reused connection, and the server called `shutdown(fd, SHUT_RDWR)` on that fd within about 1 ms of the client writing the new request. Every successful streamed request...
Companies and products named
About this problem
Evidence
7 posts from 7 people in 2 places, about 1 a week over 47 days. Mostly on ggml-org/llama.cpp, magnitudedev/magnitude. Tools named alongside: NVIDIA, GitHub, Hugging Face, TLDR.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "breaking-changes" rule about llama.cpp. First post Sep 29, 2026, latest Nov 14, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
GitHub upgrades break working setups
109 posts from 94 people on GitHub issues, Hacker News, Stack Overflow.
Upgrades and new releases break working setups
94 posts from 76 people on GitHub issues, Reddit, App Store reviews.
Claude Code upgrades break working setups
82 posts from 73 people on GitHub issues, Hacker News, Reddit.
Codex upgrades break working setups
72 posts from 65 people on GitHub issues, Reddit.
DuckDB upgrades break working setups
55 posts from 42 people on GitHub issues.
Claude upgrades break working setups
46 posts from 44 people on GitHub issues, Reddit, Hacker News.
Ollama upgrades break working setups
40 posts from 20 people on GitHub issues.
ClickHouse upgrades break working setups
37 posts from 21 people on GitHub issues.
OpenAI upgrades break working setups
32 posts from 32 people on GitHub issues, Reddit, Community forums.
Anthropic upgrades break working setups
30 posts from 24 people on GitHub issues.
ChatGPT upgrades break working setups
29 posts from 29 people on GitHub issues, Community forums, App Store reviews.
PyTorch upgrades break working setups
29 posts from 23 people on GitHub issues, Reddit.
Other llama.cpp problems
Trouble with llama.cpp misc
Top post: "Misc. bug: Severe drop in prompt processing speed after b10780 on Vulkan, RDNA3", one of 28 posts from 25 people on GitHub issues.
llama.cpp users keep filing bugs
Top post: "llama-ui : unable to open reasoning level selection menu on desktop", one of 16 posts from 16 people on GitHub issues, Reddit.
Fine-tuning llama.cpp is costly and unpredictable
6 posts from 6 people on GitHub issues, Hacker News.
Trouble with llama.cpp compile
Top post: "Compile bug: rocm-6.3.4, no matching function for call to group_mask_warp_inplace", one of 6 posts from 5 people on GitHub issues.
llama.cpp runs out of memory
4 posts from 4 people on GitHub issues.
llama.cpp runs out of context on real work
4 posts from 4 people on GitHub issues.
llama.cpp lock-in makes switching costly
3 posts from 3 people on GitHub issues.
Experiments on llama.cpp are hard to reproduce and track
3 posts from 3 people on GitHub issues.
llama.cpp tables suffer from small files and skew
2 posts from 2 people on GitHub issues. Unverified.
Trouble with llama.cpp flash
Top post: "Feature Request: Support GLM5.3 (flash)", one of 2 posts from 2 people on GitHub issues, Reddit. Unverified.
llama.cpp fails to return valid structured output
2 posts from 2 people on GitHub issues. Unverified.
Trouble with llama.cpp builds
Top post: "Feature Request: update ROCm release builds 10.0.0 -> 10.1.0", one of 2 posts from 2 people on GitHub issues. Unverified.
History