llama.cpp

Open source project13 problems47 posts+6 this week

Filter problems

Problem posts per week113 posts, week of Aug 24 to week of Sep 21

Problems

Problem	Companies	Last 30 days	Active	Seen on	This week
Fine-tuning is costly and results are unpredictableMLOpsHugging Face, GitHub, llama.cpp, PyTorch, NVIDIA, Tesla5d activeSeen on GitHub issues, Hacker News, Reddit	Hugging Face, GitHub, llama.cpp, PyTorch, NVIDIA, Tesla		5d activesince Sep 14	Seen on GitHub issues, Hacker News, Reddit	+44 posts in the last 7 days, 1 the 7 days before (rising)
Small files, skew and partitioning hurt performanceData engineeringGitHub, Apache Iceberg, llama.cpp, Claude Code, Microsoft Azure, Polars9d activeSeen on GitHub issues, Reddit	GitHub, Apache Iceberg, llama.cpp, Claude Code, Microsoft Azure, Polars		9d activesince Aug 28	Seen on GitHub issues, Reddit	+33 posts in the last 7 days, 0 the 7 days before (rising)
vLLM users keep filing bugsMLOpsvLLM, GitHub, NVIDIA, Kubernetes, llama.cpp, Qwen12d activeSeen on GitHub issues, Reddit	vLLM, GitHub, NVIDIA, Kubernetes, llama.cpp, Qwen		12d activesince Aug 27	Seen on GitHub issues, Reddit	+55 posts in the last 7 days, 1 the 7 days before (rising)
Docker users keep filing bugsDevOps and infraDocker, n8n, Grafana, Supabase, llama.cpp, Gemini9d activeSeen on GitHub issues, Stack Overflow, Community forums	Docker, n8n, Grafana, Supabase, llama.cpp, Gemini		9d activesince Aug 27	Seen on GitHub issues, Stack Overflow, Community forums	+44 posts in the last 7 days, 1 the 7 days before (rising)
No reliable way to evaluate LLM app qualityLLM appsllama.cpp, NVIDIA, Hugging Face, Qwen, GitHub, MLflow15d activeSeen on GitHub issues, Hacker News, Reddit	llama.cpp, NVIDIA, Hugging Face, Qwen, GitHub, MLflow		15d activesince Aug 27	Seen on GitHub issues, Hacker News, Reddit	+33 posts in the last 7 days, 3 the 7 days before (steady)
Running Ollama locally hits memory and speed limitsMLOpsOllama, NVIDIA, GitHub, LM Studio, Docker, llama.cpp7d activeSeen on GitHub issues	Ollama, NVIDIA, GitHub, LM Studio, Docker, llama.cpp		7d activesince Aug 28	Seen on GitHub issues	+22 posts in the last 7 days, 2 the 7 days before (steady)
Running llama.cpp locally hits memory and speed limitsMLOpsllama.cpp, NVIDIA, Hugging Face, GitHub, Tesla, Unsloth6d activeSeen on GitHub issues, Reddit	llama.cpp, NVIDIA, Hugging Face, GitHub, Tesla, Unsloth		6d activesince Aug 27	Seen on GitHub issues, Reddit	+11 post in the last 7 days, 1 the 7 days before (steady)
NVIDIA users keep filing bugsMLOpsNVIDIA, llama.cpp, TensorFlow, Hugging Face, PyTorch, GitHub6d activeSeen on GitHub issues, Stack Overflow	NVIDIA, llama.cpp, TensorFlow, Hugging Face, PyTorch, GitHub		6d activesince Aug 27	Seen on GitHub issues, Stack Overflow	+11 post in the last 7 days, 1 the 7 days before (steady)
llama.cpp users keep filing bugsMLOpsllama.cpp, GitHub, Docker, Qualcomm4d activeSeen on GitHub issues	llama.cpp, GitHub, Docker, Qualcomm		4d activesince Aug 29	Seen on GitHub issues	+11 post in the last 7 days, 1 the 7 days before (steady)
Running DeepSeek locally hits memory and speed limitsMLOpsDeepSeek, Hugging Face, Llama, llama.cpp, NVIDIA, GitHub2d activeSeen on GitHub issuesUnverified	DeepSeek, Hugging Face, Llama, llama.cpp, NVIDIA, GitHub		2d activesince Sep 13	Seen on GitHub issues	+11 post in the last 7 days, 1 the 7 days before (steady)
Ollama users keep filing bugsMLOpsOllama, GitHub, NVIDIA, vLLM, llama.cpp, Hugging Face6d activeSeen on GitHub issues	Ollama, GitHub, NVIDIA, vLLM, llama.cpp, Hugging Face		6d activesince Aug 27	Seen on GitHub issues	+00 posts in the last 7 days, 4 the 7 days before (fading)
Trouble with llama.cpp miscMLOpsllama.cpp, NVIDIA, GitHub4d activeSeen on GitHub issues	llama.cpp, NVIDIA, GitHub		4d activesince Sep 5	Seen on GitHub issues	+00 posts in the last 7 days, 2 the 7 days before (fading)
Running OpenAI locally hits memory and speed limitsMLOpsOpenAI, llama.cpp, Hugging Face, NVIDIA, Ollama, PyTorch2d activeSeen on GitHub issuesUnverified	OpenAI, llama.cpp, Hugging Face, NVIDIA, Ollama, PyTorch		2d activesince Sep 7	Seen on GitHub issues	+00 posts in the last 7 days, 1 the 7 days before (fading)

About

Problems here are about llama.cpp or name it. It is tracked from the product list on the Method page. Website: github.com.

Rising problems by email

Mondays: the problems in data, tech and AI that grew fastest that week.