RAG on Anthropic returns irrelevant or missing context
5 posts from 5 people5d activeFading, +0 this week
Posts per day
The posts behind it
text-splitters: SentenceTransformersTokenTextSplitter drops content tokens for tokenizers without both BOS and EOS
### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...
[text-splitters] Dead code in HTMLSemanticPreservingSplitter._process_links() + markdown links broken at chunk boundaries
### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...
[Feature]: Add format_context utility in langchain_core.documents for RAG prompts
### Submission checklist - [x] This is a feature request, not a bug report or usage question. - [x] I added a clear and descriptive title that summarizes the feature request. - [x] I used the GitHub search to find a similar feature request and didn't find it. - [x] I checked the...
10 YOE Fullstack Dev pivoting to MLOps & Private Enterprise AI - Reality check on my plan and a 270h course ?
...self-hosted LLM infrastructure?. Appreciate any honest feedback, reality checks, or advice on how to position this transition!. TL;DR: 10 YOE Fullstack Dev pivoting to MLOps/Private AI deployment. Taking a 270h intensive course on ML, GenAI, Cloud, and MLOps. Is this background...
text-splitters: `RecursiveJsonSplitter` sizes chunks against escaped JSON, so `ensure_ascii=False` chunks come back far below `max_chunk_size`
...the same document. `split_json` doesn't take `ensure_ascii` at all, so there's currently no way to ask for the unescaped measurement. Happy to open a PR: thread `ensure_ascii` from `split_text` through `split_json` and `_json_split` into `_json_size`, defaulting to `True`...
Companies and products named
About this problem
Evidence
5 posts from 5 people in 2 places, about 1 a week over 42 days. Mostly on langchain-ai/langchain, r/mlops. Tools named alongside: OpenAI, Perplexity, DeepSeek, Ollama.
Frustration Frustration 2 of 3· Seen on GitHub issues, Reddit
How it was grouped
Posts that state a pain and match the "rag-retrieval" rule about Anthropic. First post Sep 22, 2026, latest Nov 2, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
RAG retrieval returns irrelevant or missing context
22 posts from 22 people on Reddit, GitHub issues, Hacker News.
RAG on GitHub returns irrelevant or missing context
10 posts from 8 people on GitHub issues, Reddit.
RAG on LangChain returns irrelevant or missing context
8 posts from 7 people on Reddit, GitHub issues, Stack Overflow.
RAG on LlamaIndex returns irrelevant or missing context
5 posts from 5 people on GitHub issues.
RAG on Claude returns irrelevant or missing context
4 posts from 4 people on GitHub issues, Reddit.
RAG on vLLM returns irrelevant or missing context
3 posts from 3 people on GitHub issues.
RAG on OpenAI returns irrelevant or missing context
3 posts from 3 people on GitHub issues.
RAG on PyTorch returns irrelevant or missing context
3 posts from 3 people on GitHub issues, Mastodon.
RAG on Llama returns irrelevant or missing context
3 posts from 2 people on Stack Overflow, Reddit.
RAG on Qdrant returns irrelevant or missing context
3 posts from 2 people on GitHub issues.
RAG on Chroma returns irrelevant or missing context
3 posts from 3 people on GitHub issues.
RAG on SQL Server returns irrelevant or missing context
2 posts from 2 people on Reddit. Unverified.
Other Anthropic problems
Running Anthropic locally hits memory and speed limits
2 posts from 2 people on Hacker News. Unverified.
Anthropic users keep filing bugs
Top post: "`HTMLHeaderTextSplitter` raises `ValueError` on init for the non-heading tags its splitter already supports", one of 36 posts from 33 people on GitHub issues, App Store reviews, Reddit.
Anthropic upgrades break working setups
27 posts from 22 people on GitHub issues.
Anthropic rate limits and usage caps block work
12 posts from 9 people on GitHub issues, Reddit, Community forums.
Trouble with Anthropic core
Top post: "core: parse_json_markdown returns the wrong value for a json5 fence and fails on other fence tags", one of 8 posts from 6 people on GitHub issues.
Anthropic token costs are hard to predict
6 posts from 6 people on Hacker News, GitHub issues, Reddit.
Trouble with Anthropic cache
Top post: "LLM cache stores a generation that fails structured-output parsing and then replays it", one of 6 posts from 6 people on GitHub issues.
Trouble with Anthropic messages
Top post: "/v1/messages: client disconnect before the first chunk leaves the upstream LLM request running", one of 6 posts from 6 people on GitHub issues.
Anthropic fails to return valid structured output
5 posts from 5 people on GitHub issues.
Anthropic runs out of context on real work
4 posts from 4 people on GitHub issues.
Trouble with Anthropic response
Top post: "mistralai: an error event inside a chat stream is silently dropped, and the truncated output is returned as a", one of 4 posts from 4 people on GitHub issues.
Anthropic pricing is too high or keeps changing
3 posts from 3 people on Hacker News, Reddit.
History