MLOps problems

27 problems, rising first. The list grows every day.

Problem	Companies	Active	Seen on	This week
Fine-tuning is costly and results are unpredictableHugging Face, GitHub, llama.cpp, PyTorch, NVIDIA, Tesla5d activeSeen on GitHub issues, Hacker News, Reddit	Hugging Face, GitHub, llama.cpp, PyTorch, NVIDIA, Tesla	5d activesince Sep 14	Seen on GitHub issues, Hacker News, Reddit	+44 posts in the last 7 days, 1 the 7 days before (rising)
vLLM users keep filing bugsvLLM, GitHub, NVIDIA, Kubernetes, llama.cpp, Qwen12d activeSeen on GitHub issues, Reddit	vLLM, GitHub, NVIDIA, Kubernetes, llama.cpp, Qwen	12d activesince Aug 27	Seen on GitHub issues, Reddit	+55 posts in the last 7 days, 1 the 7 days before (rising)
Fine-tuning Qwen is costly and unpredictableQwen, vLLM, PyTorch, NVIDIA2d activeSeen on Hacker News, GitHub issuesUnverified	Qwen, vLLM, PyTorch, NVIDIA	2d activesince Sep 19	Seen on Hacker News, GitHub issues	+22 posts in the last 7 days, 0 the 7 days before (new)
Running Qwen locally hits memory and speed limitsQwen, Ollama, LM Studio, VS Code, Hugging Face, Docker2d activeSeen on Reddit, GitHub issues	Qwen, Ollama, LM Studio, VS Code, Hugging Face, Docker	2d activesince Aug 31	Seen on Reddit, GitHub issues	+33 posts in the last 7 days, 0 the 7 days before (rising)
Trouble with Ollama chatOllama, n8n3d activeSeen on Community forums, GitHub issues	Ollama, n8n	3d activesince Sep 11	Seen on Community forums, GitHub issues	+22 posts in the last 7 days, 0 the 7 days before (rising)
Running Ollama locally hits memory and speed limitsOllama, NVIDIA, GitHub, LM Studio, Docker, llama.cpp7d activeSeen on GitHub issues	Ollama, NVIDIA, GitHub, LM Studio, Docker, llama.cpp	7d activesince Aug 28	Seen on GitHub issues	+22 posts in the last 7 days, 2 the 7 days before (steady)
Running LLMs locally hits memory and speed limitsGitHub, Pinecone, PyTorch, OpenAI, vLLM, Hugging Face5d activeSeen on Reddit, GitHub issues	GitHub, Pinecone, PyTorch, OpenAI, vLLM, Hugging Face	5d activesince Sep 6	Seen on Reddit, GitHub issues	+22 posts in the last 7 days, 1 the 7 days before (steady)
MLflow users keep filing bugsMLflow, Databricks, GitHub, SQLite, PyPI, PostgreSQL11d activeSeen on GitHub issues	MLflow, Databricks, GitHub, SQLite, PyPI, PostgreSQL	11d activesince Aug 27	Seen on GitHub issues	+22 posts in the last 7 days, 2 the 7 days before (steady)
Hugging Face users keep filing bugsHugging Face, GitHub, PyTorch, NVIDIA13d activeSeen on GitHub issues, Community forums, Stack Overflow	Hugging Face, GitHub, PyTorch, NVIDIA	13d activesince Aug 28	Seen on GitHub issues, Community forums, Stack Overflow	+33 posts in the last 7 days, 6 the 7 days before (fading)
PyTorch users keep filing bugsPyTorch, GitHub, Hugging Face, NVIDIA, vLLM, GitHub Actions8d activeSeen on GitHub issues	PyTorch, GitHub, Hugging Face, NVIDIA, vLLM, GitHub Actions	8d activesince Sep 2	Seen on GitHub issues	+11 post in the last 7 days, 3 the 7 days before (fading)
Running llama.cpp locally hits memory and speed limitsllama.cpp, NVIDIA, Hugging Face, GitHub, Tesla, Unsloth6d activeSeen on GitHub issues, Reddit	llama.cpp, NVIDIA, Hugging Face, GitHub, Tesla, Unsloth	6d activesince Aug 27	Seen on GitHub issues, Reddit	+11 post in the last 7 days, 1 the 7 days before (steady)
Deploying and serving models is harder than trainingMLflow, GitHub, ChatGPT, Codex, Llama, Ollama7d activeSeen on GitHub issues, Hacker News, Reddit	MLflow, GitHub, ChatGPT, Codex, Llama, Ollama	7d activesince Aug 31	Seen on GitHub issues, Hacker News, Reddit	+11 post in the last 7 days, 2 the 7 days before (steady)
NVIDIA users keep filing bugsNVIDIA, llama.cpp, TensorFlow, Hugging Face, PyTorch, GitHub6d activeSeen on GitHub issues, Stack Overflow	NVIDIA, llama.cpp, TensorFlow, Hugging Face, PyTorch, GitHub	6d activesince Aug 27	Seen on GitHub issues, Stack Overflow	+11 post in the last 7 days, 1 the 7 days before (steady)
llama.cpp users keep filing bugsllama.cpp, GitHub, Docker, Qualcomm4d activeSeen on GitHub issues	llama.cpp, GitHub, Docker, Qualcomm	4d activesince Aug 29	Seen on GitHub issues	+11 post in the last 7 days, 1 the 7 days before (steady)
ML experiments are hard to reproduce and trackMLflow, GitHub, LlamaIndex, OpenAI, Claude, Amazon Bedrock4d activeSeen on GitHub issues	MLflow, GitHub, LlamaIndex, OpenAI, Claude, Amazon Bedrock	4d activesince Sep 2	Seen on GitHub issues	+11 post in the last 7 days, 1 the 7 days before (steady)
GPU access, drivers and CUDA versions are painfulvLLM, GitHub, OpenAI, Qwen, Hugging Face, NVIDIA3d activeSeen on GitHub issues, Reddit	vLLM, GitHub, OpenAI, Qwen, Hugging Face, NVIDIA	3d activesince Aug 28	Seen on GitHub issues, Reddit	+11 post in the last 7 days, 0 the 7 days before (steady)
NVIDIA GPU access and drivers are painfulNVIDIA, OpenAI, Hugging Face, PyPI, PyTorch2d activeSeen on Mastodon, GitHub issuesUnverified	NVIDIA, OpenAI, Hugging Face, PyPI, PyTorch	2d activesince Sep 14	Seen on Mastodon, GitHub issues	+11 post in the last 7 days, 1 the 7 days before (steady)
Running DeepSeek locally hits memory and speed limitsDeepSeek, Hugging Face, Llama, llama.cpp, NVIDIA, GitHub2d activeSeen on GitHub issuesUnverified	DeepSeek, Hugging Face, Llama, llama.cpp, NVIDIA, GitHub	2d activesince Sep 13	Seen on GitHub issues	+11 post in the last 7 days, 1 the 7 days before (steady)
Fine-tuning Gemini is costly and unpredictableGemini, LM Studio, GitHub Copilot, Vertex AI, VS Code2d activeSeen on Reddit, GitHub issuesUnverified	Gemini, LM Studio, GitHub Copilot, Vertex AI, VS Code	2d activesince Sep 3	Seen on Reddit, GitHub issues	+11 post in the last 7 days, 0 the 7 days before (steady)
Ollama users keep filing bugsOllama, GitHub, NVIDIA, vLLM, llama.cpp, Hugging Face6d activeSeen on GitHub issues	Ollama, GitHub, NVIDIA, vLLM, llama.cpp, Hugging Face	6d activesince Aug 27	Seen on GitHub issues	+00 posts in the last 7 days, 4 the 7 days before (fading)
Trouble with llama.cpp miscllama.cpp, NVIDIA, GitHub4d activeSeen on GitHub issues	llama.cpp, NVIDIA, GitHub	4d activesince Sep 5	Seen on GitHub issues	+00 posts in the last 7 days, 2 the 7 days before (fading)
Running vLLM locally hits memory and speed limitsvLLM, GitHub, NVIDIA, Hugging Face, Oracle3d activeSeen on GitHub issues	vLLM, GitHub, NVIDIA, Hugging Face, Oracle	3d activesince Sep 1	Seen on GitHub issues	+00 posts in the last 7 days, 1 the 7 days before (fading)
PyTorch GPU access and drivers are painfulPyTorch, NVIDIA, GitHub, Docker3d activeSeen on GitHub issues	PyTorch, NVIDIA, GitHub, Docker	3d activesince Aug 28	Seen on GitHub issues	+00 posts in the last 7 days, 0 the 7 days before (fading)
Trouble with PyTorch testPyTorch, NVIDIA, GitHub2d activeSeen on GitHub issues	PyTorch, NVIDIA, GitHub	2d activesince Sep 3	Seen on GitHub issues	+00 posts in the last 7 days, 0 the 7 days before (fading)
Running OpenAI locally hits memory and speed limitsOpenAI, llama.cpp, Hugging Face, NVIDIA, Ollama, PyTorch2d activeSeen on GitHub issuesUnverified	OpenAI, llama.cpp, Hugging Face, NVIDIA, Ollama, PyTorch	2d activesince Sep 7	Seen on GitHub issues	+00 posts in the last 7 days, 1 the 7 days before (fading)
Serving models on Ollama is harder than it should beOllama, GitHub, Hugging Face, ChatGPT, Codex2d activeSeen on GitHub issuesUnverified	Ollama, GitHub, Hugging Face, ChatGPT, Codex	2d activesince Aug 31	Seen on GitHub issues	+00 posts in the last 7 days, 1 the 7 days before (fading)
Jupyter users keep asking for helpJupyter, pandas, SQL Server, Power BI, GitHub, Microsoft Azure2d activeSeen on Stack Overflow, GitHub issuesUnverified	Jupyter, pandas, SQL Server, Power BI, GitHub, Microsoft Azure	2d activesince Sep 2	Seen on Stack Overflow, GitHub issues	+00 posts in the last 7 days, 0 the 7 days before (fading)

MLOps problems

Rising problems by email