Data and AI struggles

1,855 problems · 352 companies

LLM apps

RAG on Anthropic returns irrelevant or missing context

5 posts from 5 people5d activeFading, +0 this week

Posts per day

Posts per day5 posts, Sep 22 to Nov 13

The posts behind it

GitHub issueslangchain-ai/langchain · raunakpandey1Nov 2

text-splitters: SentenceTransformersTokenTextSplitter drops content tokens for tokenizers without both BOS and EOS

### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...

2 replies
GitHub issueslangchain-ai/langchain · Inkesk-DozingOct 18

[text-splitters] Dead code in HTMLSemanticPreservingSplitter._process_links() + markdown links broken at chunk boundaries

### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...

2 replies
GitHub issueslangchain-ai/langchain · saptarshiroy39Oct 8

[Feature]: Add format_context utility in langchain_core.documents for RAG prompts

### Submission checklist - [x] This is a feature request, not a bug report or usage question. - [x] I added a clear and descriptive title that summarizes the feature request. - [x] I used the GitHub search to find a similar feature request and didn't find it. - [x] I checked the...

1 replies
Redditr/mlops · u/GuysmoSep 24

10 YOE Fullstack Dev pivoting to MLOps & Private Enterprise AI - Reality check on my plan and a 270h course ?

...self-hosted LLM infrastructure?. Appreciate any honest feedback, reality checks, or advice on how to position this transition!. TL;DR: 10 YOE Fullstack Dev pivoting to MLOps/Private AI deployment. Taking a 270h intensive course on ML, GenAI, Cloud, and MLOps. Is this background...

GitHub issueslangchain-ai/langchain · pablo-legerenSep 22

text-splitters: `RecursiveJsonSplitter` sizes chunks against escaped JSON, so `ensure_ascii=False` chunks come back far below `max_chunk_size`

...the same document. `split_json` doesn't take `ensure_ascii` at all, so there's currently no way to ask for the unescaped measurement. Happy to open a PR: thread `ensure_ascii` from `split_text` through `split_json` and `_json_split` into `_json_size`, defaulting to `True`...

3 replies

Companies and products named

5 posts
5 posts
4 posts
4 posts
4 posts
4 posts
About this problem

Evidence

5 posts from 5 people in 2 places, about 1 a week over 42 days. Mostly on langchain-ai/langchain, r/mlops. Tools named alongside: OpenAI, Perplexity, DeepSeek, Ollama.

Frustration Frustration 2 of 3· Seen on GitHub issues, Reddit

How it was grouped

Posts that state a pain and match the "rag-retrieval" rule about Anthropic. First post Sep 22, 2026, latest Nov 2, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

The same problem elsewhere

RAG retrieval returns irrelevant or missing context

22 posts from 22 people on Reddit, GitHub issues, Hacker News.

RAG on GitHub returns irrelevant or missing context

10 posts from 8 people on GitHub issues, Reddit.

RAG on LangChain returns irrelevant or missing context

8 posts from 7 people on Reddit, GitHub issues, Stack Overflow.

RAG on LlamaIndex returns irrelevant or missing context

5 posts from 5 people on GitHub issues.

RAG on Claude returns irrelevant or missing context

4 posts from 4 people on GitHub issues, Reddit.

RAG on vLLM returns irrelevant or missing context

3 posts from 3 people on GitHub issues.

RAG on OpenAI returns irrelevant or missing context

3 posts from 3 people on GitHub issues.

RAG on PyTorch returns irrelevant or missing context

3 posts from 3 people on GitHub issues, Mastodon.

RAG on Llama returns irrelevant or missing context

3 posts from 2 people on Stack Overflow, Reddit.

RAG on Qdrant returns irrelevant or missing context

3 posts from 2 people on GitHub issues.

RAG on Chroma returns irrelevant or missing context

3 posts from 3 people on GitHub issues.

RAG on SQL Server returns irrelevant or missing context

2 posts from 2 people on Reddit. Unverified.

Other Anthropic problems

Running Anthropic locally hits memory and speed limits

2 posts from 2 people on Hacker News. Unverified.

Anthropic users keep filing bugs

Top post: "`HTMLHeaderTextSplitter` raises `ValueError` on init for the non-heading tags its splitter already supports", one of 36 posts from 33 people on GitHub issues, App Store reviews, Reddit.

Anthropic upgrades break working setups

27 posts from 22 people on GitHub issues.

Anthropic rate limits and usage caps block work

12 posts from 9 people on GitHub issues, Reddit, Community forums.

Trouble with Anthropic core

Top post: "core: parse_json_markdown returns the wrong value for a json5 fence and fails on other fence tags", one of 8 posts from 6 people on GitHub issues.

Anthropic token costs are hard to predict

6 posts from 6 people on Hacker News, GitHub issues, Reddit.

Trouble with Anthropic cache

Top post: "LLM cache stores a generation that fails structured-output parsing and then replays it", one of 6 posts from 6 people on GitHub issues.

Trouble with Anthropic messages

Top post: "/v1/messages: client disconnect before the first chunk leaves the upstream LLM request running", one of 6 posts from 6 people on GitHub issues.

Anthropic fails to return valid structured output

5 posts from 5 people on GitHub issues.

Anthropic runs out of context on real work

4 posts from 4 people on GitHub issues.

Trouble with Anthropic response

Top post: "mistralai: an error event inside a chat stream is silently dropped, and the truncated output is returned as a", one of 4 posts from 4 people on GitHub issues.

Anthropic pricing is too high or keeps changing

3 posts from 3 people on Hacker News, Reddit.

History

Momentum went from steady to fading.

Nov 9, 2026

Momentum went from fading to steady.

Nov 6, 2026

Momentum went from steady to fading.

Oct 25, 2026

Momentum went from fading to steady.

Oct 19, 2026

Momentum went from steady to fading.

Oct 15, 2026

Corroborated: 3 or more posts from 2 or more people or places.

Oct 11, 2026

Momentum went from fading to steady.

Oct 11, 2026

Momentum went from new to fading.

Oct 2, 2026

First seen with 2 posts.

Sep 28, 2026