Data and AI struggles

2,114 problems · 377 companies

Outages and change

llama.cpp upgrades break working setups

7 posts from 7 people7d activeFading, +0 this week

Posts per day

Posts per day7 posts, Sep 29 to Nov 21

The posts behind it

GitHub issuesggml-org/llama.cpp · NumericalAnalysisNov 14

Misc. bug: [Regression] Significant prefill performance drop on V100 (sm_70) in v1.0.0 compared to v0.8.0

...Meta() but Flash Attention over K/V rows is assigned to device CPU (usually due to missing support) W resolve_fused_ops: Flash Attention over K/V rows not supported, set to disabled I attempted to remove the -kvu (unified KV-cache) flag to see if it would resolve the issue....

4 replies
GitHub issuesggml-org/llama.cpp · marcelromanoNov 6

Proposal: Investigate speculative decoding checkpoint initialization

**Status & Context:** Unverified hypothesis for investigation, not a confirmed upstream bug or fix proposal. Upstream issue [#29811](https://github.com/ggml-org/llama.cpp/issues/29811) discusses MTP startup assertion failures; a shared root cause has not been established....

GitHub issuesggml-org/llama.cpp · cennacOct 16

vulkan: ~3x decode regression with spec decode + large -c on multi-device systems since e0bcacc

..."acceptance unchanged, throughput collapses" / crawling-spec signature): #30568, #30552. Workarounds today: `GGML_VK_VISIBLE_DEVICES= ` limited to the compute device, or revert of e0bcacc. Question: should the multi-device gpu-visible host-memory pool be skipped when a single...

1 reactions1 replies
GitHub issuesmagnitudedev/magnitude · lloydgreenwaldOct 5

v0.2.4 treats memory differently than v0.1.5, eliminating the ability to run larger models without closing all open apps

...the backend allows it, as llama.cpp did with `NoCopy` shared buffers on Apple Silicon. Failing that, offer an option for it. Either way, admission could then count file-backed weights as reclaimable.

GitHub issuesggml-org/llama.cpp · hasanyazarrOct 3

Feature Request: gemma4 31B chat template quadratic scan cost

### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...

1 replies
GitHub issuesggml-org/llama.cpp · Coderx7Oct 2

Feature Request: gracefully ignore missing/invalid arguments instead of failing the model loading in serve mode

### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...

GitHub issuesggml-org/llama.cpp · viiiviii538Sep 29

server: streaming responses advertise Keep-Alive but the connection is closed after the stream, causing ReadError/RemoteProtocolError on pooled HTTP clients

...gaps (570 requests in one day, 7/283 vs 0/286). Under `strace` of llama-server, every failing request was on a reused connection, and the server called `shutdown(fd, SHUT_RDWR)` on that fd within about 1 ms of the client writing the new request. Every successful streamed request...

Companies and products named

7 posts
4 posts
3 posts
1 post
1 post
About this problem

Evidence

7 posts from 7 people in 2 places, about 1 a week over 47 days. Mostly on ggml-org/llama.cpp, magnitudedev/magnitude. Tools named alongside: NVIDIA, GitHub, Hugging Face, TLDR.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "breaking-changes" rule about llama.cpp. First post Sep 29, 2026, latest Nov 14, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

The same problem elsewhere

GitHub upgrades break working setups

109 posts from 94 people on GitHub issues, Hacker News, Stack Overflow.

Upgrades and new releases break working setups

94 posts from 76 people on GitHub issues, Reddit, App Store reviews.

Claude Code upgrades break working setups

82 posts from 73 people on GitHub issues, Hacker News, Reddit.

Codex upgrades break working setups

72 posts from 65 people on GitHub issues, Reddit.

DuckDB upgrades break working setups

55 posts from 42 people on GitHub issues.

Claude upgrades break working setups

46 posts from 44 people on GitHub issues, Reddit, Hacker News.

Ollama upgrades break working setups

40 posts from 20 people on GitHub issues.

ClickHouse upgrades break working setups

37 posts from 21 people on GitHub issues.

OpenAI upgrades break working setups

32 posts from 32 people on GitHub issues, Reddit, Community forums.

Anthropic upgrades break working setups

30 posts from 24 people on GitHub issues.

ChatGPT upgrades break working setups

29 posts from 29 people on GitHub issues, Community forums, App Store reviews.

PyTorch upgrades break working setups

29 posts from 23 people on GitHub issues, Reddit.

Other llama.cpp problems

Trouble with llama.cpp misc

Top post: "Misc. bug: Severe drop in prompt processing speed after b10780 on Vulkan, RDNA3", one of 28 posts from 25 people on GitHub issues.

llama.cpp users keep filing bugs

Top post: "llama-ui : unable to open reasoning level selection menu on desktop", one of 16 posts from 16 people on GitHub issues, Reddit.

Fine-tuning llama.cpp is costly and unpredictable

6 posts from 6 people on GitHub issues, Hacker News.

Trouble with llama.cpp compile

Top post: "Compile bug: rocm-6.3.4, no matching function for call to group_mask_warp_inplace", one of 6 posts from 5 people on GitHub issues.

llama.cpp runs out of memory

4 posts from 4 people on GitHub issues.

llama.cpp runs out of context on real work

4 posts from 4 people on GitHub issues.

llama.cpp lock-in makes switching costly

3 posts from 3 people on GitHub issues.

Experiments on llama.cpp are hard to reproduce and track

3 posts from 3 people on GitHub issues.

llama.cpp tables suffer from small files and skew

2 posts from 2 people on GitHub issues. Unverified.

Trouble with llama.cpp flash

Top post: "Feature Request: Support GLM5.3 (flash)", one of 2 posts from 2 people on GitHub issues, Reddit. Unverified.

llama.cpp fails to return valid structured output

2 posts from 2 people on GitHub issues. Unverified.

Trouble with llama.cpp builds

Top post: "Feature Request: update ROCm release builds 10.0.0 -> 10.1.0", one of 2 posts from 2 people on GitHub issues. Unverified.

History

Momentum went from steady to fading.

Nov 21, 2026

Momentum went from fading to steady.

Nov 17, 2026

Momentum went from steady to fading.

Nov 13, 2026

Momentum went from fading to steady.

Nov 8, 2026

Momentum went from steady to fading.

Oct 23, 2026

Momentum went from fading to steady.

Oct 21, 2026

Momentum went from steady to fading.

Oct 10, 2026

Momentum went from rising to steady.

Oct 9, 2026

Momentum went from new to rising.

Oct 6, 2026

First seen with 3 posts.

Oct 5, 2026