Skip to content

MLOps problems

9 problems, longest running first. The list grows every day.

ProblemThis week
Hugging Face users keep filing bugsHugging Face, GitHub, PyTorch, NVIDIA13d activeSeen on GitHub issues, Community forums, Stack Overflow+33 posts in the last 7 days, 6 the 7 days before (fading)
vLLM users keep filing bugsvLLM, GitHub, NVIDIA, Kubernetes, llama.cpp, Qwen12d activeSeen on GitHub issues, Reddit+55 posts in the last 7 days, 1 the 7 days before (rising)
MLflow users keep filing bugsMLflow, Databricks, GitHub, SQLite, PyPI, PostgreSQL11d activeSeen on GitHub issues+22 posts in the last 7 days, 2 the 7 days before (steady)
PyTorch users keep filing bugsPyTorch, GitHub, Hugging Face, NVIDIA, vLLM, GitHub Actions8d activeSeen on GitHub issues+11 post in the last 7 days, 3 the 7 days before (fading)
Running Ollama locally hits memory and speed limitsOllama, NVIDIA, GitHub, LM Studio, Docker, llama.cpp7d activeSeen on GitHub issues+22 posts in the last 7 days, 2 the 7 days before (steady)
Deploying and serving models is harder than trainingMLflow, GitHub, ChatGPT, Codex, Llama, Ollama7d activeSeen on GitHub issues, Hacker News, Reddit+11 post in the last 7 days, 2 the 7 days before (steady)
Running llama.cpp locally hits memory and speed limitsllama.cpp, NVIDIA, Hugging Face, GitHub, Tesla, Unsloth6d activeSeen on GitHub issues, Reddit+11 post in the last 7 days, 1 the 7 days before (steady)
NVIDIA users keep filing bugsNVIDIA, llama.cpp, TensorFlow, Hugging Face, PyTorch, GitHub6d activeSeen on GitHub issues, Stack Overflow+11 post in the last 7 days, 1 the 7 days before (steady)
Running LLMs locally hits memory and speed limitsGitHub, Pinecone, PyTorch, OpenAI, vLLM, Hugging Face5d activeSeen on Reddit, GitHub issues+22 posts in the last 7 days, 1 the 7 days before (steady)

Rising problems by email

Mondays: the problems in data, tech and AI that grew fastest that week.

Double opt-in. Unsubscribe any time.