Problemsby GlyphRunning Anthropic locally hits memory and speed limits
2 posts from 2 people2d activeNew, +2 this weekunverified
Posts per day
The posts behind it
...or me having a bad day. Conspicuously the model seems to be especially dumb and annoying when I did not get a lot of sleep the previous night. When OpenAI and Anthropic engineers post here on HN that they do not quantize models and silently replace checkpoints in the API, I...
...from caches to consumers of their API's [?]). VRAM, meanwhile, still remains the bottleneck for consumers. I think this means those working for Anthropic/OpenAI/etc won't be making as many meaningful advances to cut down VRAM for inferences. Why do thusly if that only allows the...
Companies and products named
About this problem
Evidence
2 posts from 2 people in 1 place, about 2 a week over 3 days. Mostly on Hacker News comments. Tools named alongside: OpenAI.
Frustration Frustration 0 of 3· Seen on Hacker News
How it was grouped
Posts that state a pain and match the "local-llm" rule about Anthropic. First post Nov 7, 2026, latest Nov 9, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
Running Ollama locally hits memory and speed limits
47 posts from 45 people on GitHub issues, Reddit.
Running llama.cpp locally hits memory and speed limits
45 posts from 41 people on GitHub issues, Reddit.
Running vLLM locally hits memory and speed limits
21 posts from 20 people on GitHub issues, Reddit.
Running LLMs locally hits memory and speed limits
21 posts from 20 people on GitHub issues, Reddit, Hacker News.
Running Qwen locally hits memory and speed limits
18 posts from 18 people on GitHub issues, Reddit, Stack Overflow.
Running Hugging Face locally hits memory and speed limits
17 posts from 15 people on GitHub issues, Reddit.
Running NVIDIA locally hits memory and speed limits
16 posts from 16 people on GitHub issues.
Running OpenAI locally hits memory and speed limits
13 posts from 13 people on GitHub issues.
Running DeepSeek locally hits memory and speed limits
8 posts from 8 people on GitHub issues, Hacker News.
Running Claude Code locally hits memory and speed limits
6 posts from 6 people on GitHub issues.
Running PyTorch locally hits memory and speed limits
5 posts from 5 people on GitHub issues, Hacker News.
Running GitHub locally hits memory and speed limits
4 posts from 4 people on Reddit, GitHub issues.
Other Anthropic problems
Anthropic users keep filing bugs
Top post: "`HTMLHeaderTextSplitter` raises `ValueError` on init for the non-heading tags its splitter already supports", one of 36 posts from 33 people on GitHub issues, App Store reviews, Reddit.
Anthropic upgrades break working setups
27 posts from 22 people on GitHub issues.
Anthropic rate limits and usage caps block work
12 posts from 9 people on GitHub issues, Reddit, Community forums.
Trouble with Anthropic core
Top post: "core: parse_json_markdown returns the wrong value for a json5 fence and fails on other fence tags", one of 8 posts from 6 people on GitHub issues.
Anthropic token costs are hard to predict
6 posts from 6 people on Hacker News, GitHub issues, Reddit.
Trouble with Anthropic cache
Top post: "LLM cache stores a generation that fails structured-output parsing and then replays it", one of 6 posts from 6 people on GitHub issues.
Trouble with Anthropic messages
Top post: "/v1/messages: client disconnect before the first chunk leaves the upstream LLM request running", one of 6 posts from 6 people on GitHub issues.
Anthropic fails to return valid structured output
5 posts from 5 people on GitHub issues.
RAG on Anthropic returns irrelevant or missing context
5 posts from 5 people on GitHub issues, Reddit.
Anthropic runs out of context on real work
4 posts from 4 people on GitHub issues.
Trouble with Anthropic response
Top post: "mistralai: an error event inside a chat stream is silently dropped, and the truncated output is returned as a", one of 4 posts from 4 people on GitHub issues.
Anthropic pricing is too high or keeps changing
3 posts from 3 people on Hacker News, Reddit.
History