Problemsby Glyphllama.cpp
Open source project51 problems277 posts+35 this week
Problem posts per week
llama.cpp problems
Running Ollama locally hits memory and speed limits
47 posts from 45 people on GitHub issues, Reddit.
Running llama.cpp locally hits memory and speed limits
45 posts from 41 people on GitHub issues, Reddit.
Running NVIDIA locally hits memory and speed limits
16 posts from 16 people on GitHub issues.
No reliable way to evaluate LLM app quality
153 posts from 144 people on GitHub issues, Reddit, Hacker News.
Ollama upgrades break working setups
21 posts from 17 people on GitHub issues.
Trouble with NVIDIA windows
Top post: "Windows CUDA prebuilt binaries stuck at b11828 while release tags keep advancing (b11846..b11852)", one of 3 posts from 3 people on GitHub issues.
Experiments on llama.cpp are hard to reproduce and track
2 posts from 2 people on GitHub issues. Unverified.
Running Claude Code locally hits memory and speed limits
6 posts from 6 people on GitHub issues.
Running DeepSeek locally hits memory and speed limits
8 posts from 8 people on GitHub issues, Hacker News.
Trouble with llama.cpp misc
Top post: "Misc. bug: Severe drop in prompt processing speed after b10780 on Vulkan, RDNA3", one of 22 posts from 22 people on GitHub issues.
Running Qwen locally hits memory and speed limits
18 posts from 18 people on GitHub issues, Reddit, Stack Overflow.
Running OpenAI locally hits memory and speed limits
13 posts from 13 people on GitHub issues.
Running Hugging Face locally hits memory and speed limits
17 posts from 15 people on GitHub issues, Reddit.
Docker users keep filing bugs
Top post: "docker: no SemVer tags / release builds missing", one of 37 posts from 35 people on GitHub issues, Stack Overflow, Reddit.
Small files, skew and partitioning hurt performance
14 posts from 14 people on GitHub issues, Hacker News.
llama.cpp users keep filing bugs
Top post: "llama-ui : unable to open reasoning level selection menu on desktop", one of 13 posts from 13 people on GitHub issues, Reddit.
Claude pricing is too high or keeps changing
8 posts from 8 people on Hacker News, Reddit, App Store reviews.
llama.cpp upgrades break working setups
6 posts from 6 people on GitHub issues.
Trouble with Anthropic messages
Top post: "/v1/messages: client disconnect before the first chunk leaves the upstream LLM request running", one of 6 posts from 6 people on GitHub issues.
Running GitHub locally hits memory and speed limits
4 posts from 4 people on Reddit, GitHub issues.
Trouble with Claude Code prompt
Top post: "Add setting to keep IDE selection indicator in footer instead of inline prompt", one of 4 posts from 4 people on GitHub issues.
Running Perplexity locally hits memory and speed limits
3 posts from 3 people on GitHub issues.
NVIDIA runs out of context on real work
2 posts from 2 people on GitHub issues. Unverified.
Trouble with GitHub dynamic
Top post: "MiBeeNVR: dynamic timelapse and thermal cameras in a self-hosted NVR that keeps your footage on your own", one of 2 posts from 2 people on GitHub issues, Reddit. Unverified.
Trouble with GitHub fast
One post on GitHub issues: "Discussion: Possible fast paths for greedy and draft sampling". Unverified.
Trouble with OpenAI audio
One post on GitHub issues: "Feature Request: Implement OpenAI's TTS /v1/audio/speech API". Unverified.
Trouble with llama.cpp compile
Top post: "Compile bug: rocm-6.3.4, no matching function for call to group_mask_warp_inplace", one of 5 posts from 5 people on GitHub issues.
Trouble with Claude prompt
Top post: "server: pinning a request to an empty slot via id_slot skips the prompt cache", one of 5 posts from 5 people on GitHub issues, App Store reviews, Reddit.
Fine-tuning llama.cpp is costly and unpredictable
4 posts from 4 people on GitHub issues, Hacker News.
About
Problems here are about llama.cpp or name it. It is tracked from the product list on the Method page. Website: github.com.