Problemsby Glyphllama.cpp users keep filing bugs
13 posts from 13 people13d activeSteady, +1 this week
Posts per day
The posts behind it
Discussion: KV capacity admission, slot restore, and per-sequence windowing
**Status & Context:** Discussion of several distinct server/cache changes, not a validated monolithic proposal. Relevant upstream work includes [PR #20993](https://github.com/ggml-org/llama.cpp/pull/20993) (idle slot cleanup), [PR...
Feature Request: Add "q8_0-q4_0" to GGML_CUDA_FA_QUANTS
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
Feature Request: Support for Raon-1 architecture
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
Llama app GUI for linux
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
I have an ESC4000 G3 with 8x T4s in it - what is the fastest way I can deploy Qwen3.5-9B for about 10-15 users concurrently: currently using llama.cpp
...on the question), and essentially prefill is at 1400 tps, so I am not sure what my bottleneck is.. VLLM on my Mi50 32GB and AWQ-INT8 (cyankiwi’s model) is very fast.. I am wondering, does anyone have any pointers? I am really not in the position to spend money, exhausted...
Feature Request: Add support for configurable completion endpoints
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
Python error right after install Unsloth
.... Does anybody know what’s going on and how can I fix it?. Many thanks!.
Feature Request: Early-exit speculative drafting via Shannon entropy (comparison with p_min)
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
Feature Request: Independent `bash-completion` for each executable
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
Feature Request: Hexagon FP8 weight support and DiT optimizations for HTP v79+
### Prerequisites - [x] I am running the latest code. Mention the version if possible as well. - [x] I carefully followed the [README.md](https://github.com/ggml-org/llama.cpp/blob/master/README.md). - [x] I searched using keywords relevant to my issue to make sure that I am...
Feature Request: do not hide the build or version number anymore
...version, or build number. Docker image? It's `ghcr.io/ggml-org/llama.cpp:server-cuda13`, impossible to tell. Docker logs? llama-server starts, and not a single peep about the version, or build number. llama-ui? If the version is exposed anywhere, it must be very well hidden. I...
llama-ui : unable to open reasoning level selection menu on desktop
### Name and Version c841aeeb8 (release b10687) ### Operating systems Linux ### Which llama.cpp modules do you know to be affected? llama-server ### Command line ### Problem description & steps to reproduce Since #27746 was merged, the reasoning menu in llama-server's webUI...
Companies and products named
About this problem
Evidence
13 posts from 13 people in 3 places, about 1 a week over 70 days. Mostly on ggml-org/llama.cpp, r/ollama, r/LocalLLaMA. Tools named alongside: GitHub, NVIDIA, Docker, Qualcomm.
Frustration Frustration 1 of 3· Seen on GitHub issues, Reddit
How it was grouped
Posts about llama.cpp that state a pain but match no known issue yet. First post Aug 29, 2026, latest Nov 6, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
Other llama.cpp problems
Running llama.cpp locally hits memory and speed limits
45 posts from 41 people on GitHub issues, Reddit.
Experiments on llama.cpp are hard to reproduce and track
2 posts from 2 people on GitHub issues. Unverified.
Trouble with llama.cpp misc
Top post: "Misc. bug: Severe drop in prompt processing speed after b10780 on Vulkan, RDNA3", one of 22 posts from 22 people on GitHub issues.
llama.cpp upgrades break working setups
6 posts from 6 people on GitHub issues.
Trouble with llama.cpp compile
Top post: "Compile bug: rocm-6.3.4, no matching function for call to group_mask_warp_inplace", one of 5 posts from 5 people on GitHub issues.
Fine-tuning llama.cpp is costly and unpredictable
4 posts from 4 people on GitHub issues, Hacker News.
llama.cpp runs out of context on real work
4 posts from 4 people on GitHub issues.
llama.cpp lock-in makes switching costly
3 posts from 3 people on GitHub issues.
llama.cpp runs out of memory
3 posts from 3 people on GitHub issues.
Trouble with llama.cpp flash
Top post: "Feature Request: Support GLM5.3 (flash)", one of 2 posts from 2 people on GitHub issues, Reddit. Unverified.
llama.cpp fails to return valid structured output
2 posts from 2 people on GitHub issues. Unverified.
Trouble with llama.cpp builds
Top post: "Feature Request: update ROCm release builds 10.0.0 -> 10.1.0", one of 2 posts from 2 people on GitHub issues. Unverified.
History