LLM apps problems
15 problems, longest running first. The list grows every day.
| Problem | This week | ||||
|---|---|---|---|---|---|
| Gemini users keep filing bugs | 16d activesince Aug 27 | Seen on GitHub issues, Community forums | +44 posts in the last 7 days, 5 the 7 days before (steady) | ||
| No reliable way to evaluate LLM app quality | 15d activesince Aug 27 | Seen on GitHub issues, Hacker News, Reddit | +33 posts in the last 7 days, 3 the 7 days before (steady) | ||
| Claude app gets 1 and 2 star reviews | 13d activesince Aug 28 | +1Seen on App Store reviews, GitHub issues, Reddit, Community forums, Stack Overflow | +2828 posts in the last 7 days, 2 the 7 days before (rising) | ||
| API rate limits and usage caps block real work | 12d activesince Aug 28 | Seen on GitHub issues, Hacker News, Reddit, Community forums | +33 posts in the last 7 days, 3 the 7 days before (steady) | ||
| ChatGPT app gets 1 and 2 star reviews | 11d activesince Aug 28 | Seen on App Store reviews, GitHub issues, Community forums | +1717 posts in the last 7 days, 1 the 7 days before (rising) | ||
| Model Context Protocol users keep filing bugs | 11d activesince Aug 28 | Seen on GitHub issues, Reddit | +44 posts in the last 7 days, 1 the 7 days before (rising) | ||
| OpenAI users keep asking for help | 9d activesince Aug 27 | Seen on Community forums, GitHub issues, Stack Overflow, Reddit | +55 posts in the last 7 days, 2 the 7 days before (rising) | ||
| LLMs give confidently wrong answers | 9d activesince Sep 2 | Seen on Hacker News, Reddit, Bluesky | +44 posts in the last 7 days, 4 the 7 days before (steady) | ||
| LlamaIndex users keep filing bugs | 9d activesince Aug 28 | Seen on GitHub issues, Stack Overflow | +22 posts in the last 7 days, 2 the 7 days before (steady) | ||
| Context windows run out on real workloads | 8d activesince Aug 28 | Seen on GitHub issues, Hacker News, Reddit, Community forums | +66 posts in the last 7 days, 0 the 7 days before (rising) | ||
| AI agents are unreliable, loop or stall midway | 8d activesince Aug 27 | Seen on GitHub issues, Hacker News, Bluesky, Reddit | +11 post in the last 7 days, 5 the 7 days before (fading) | ||
| Anthropic users keep filing bugs | 7d activesince Aug 27 | Seen on GitHub issues, App Store reviews, Reddit | +66 posts in the last 7 days, 0 the 7 days before (rising) | ||
| RAG retrieval returns irrelevant or missing context | 6d activesince Aug 28 | Seen on GitHub issues, Hacker News, DEV, Reddit | +33 posts in the last 7 days, 1 the 7 days before (rising) | ||
| Models fail to return valid structured output | 6d activesince Aug 31 | Seen on GitHub issues, Hacker News, Reddit | +22 posts in the last 7 days, 2 the 7 days before (steady) | ||
| Grok users keep asking for help | 6d activesince Aug 25 | Seen on Community forums, App Store reviews | +44 posts in the last 7 days, 0 the 7 days before (rising) |