Data and AI struggles

1,307 problems · 307 companies

LLM apps

Trouble with Anthropic cache

3 posts from 3 people3d activeSteady, +1 this week

Posts per day

Posts per day3 posts, Oct 2 to Oct 28

The posts behind it

GitHub issueslangchain-ai/langchain · NEGU93Oct 23

LLM cache stores a generation that fails structured-output parsing and then replays it

.../ general ### Related Issues / PRs This is not #29003 / #27264 / #25613. Those are about failing to deserialize a valid structured result from SQLite, Redis, or Elasticsearch. Here the generation is stored and read back fine. The stored generation is one the structured-output...

4 replies
GitHub issuesmlflow/mlflow · pcbeingused333Oct 20

[BUG] Anthropic gateway streams ignore the final input and cache token counts in message_delta

> [!WARNING] > Before submitting a PR, please make sure that: > - A maintainer has triaged this issue and applied the `ready` label > - This issue has no assignee > - No duplicate PR exists > > PRs not meeting these requirements may be automatically closed. ### MLflow version -...

2 replies
GitHub issueslangchain-ai/langchain · jeon-jihyeonOct 2

ModelFallbackMiddleware strips cache_control when falling back to ChatAnthropicMantle

### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...

2 replies

Companies and products named

3 posts
2 posts
2 posts
2 posts
2 posts
About this problem

Evidence

3 posts from 3 people in 2 places, about 1 a week over 22 days. Mostly on langchain-ai/langchain, mlflow/mlflow. Tools named alongside: OpenAI, Perplexity, DeepSeek, Ollama.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts about Anthropic with no known issue, sharing the word "cache". First post Oct 2, 2026, latest Oct 23, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

Other Anthropic problems

Anthropic upgrades break working setups

24 posts from 19 people on GitHub issues.

Anthropic rate limits and usage caps block work

12 posts from 9 people on GitHub issues, Reddit, Community forums.

Anthropic users keep filing bugs

Top post: "`HTMLHeaderTextSplitter` raises `ValueError` on init for the non-heading tags its splitter already supports", one of 30 posts from 29 people on GitHub issues, App Store reviews, Community forums.

Trouble with Anthropic core

Top post: "core: filter_messages(exclude_tool_calls=[...]) does not remove invalid_tool_calls", one of 6 posts from 5 people on GitHub issues.

Trouble with Anthropic crashes

Top post: "Streaming parser crashes when a tool-call delta has function=None", one of 4 posts from 4 people on GitHub issues.

Anthropic token costs are hard to predict

4 posts from 4 people on GitHub issues, Hacker News, Reddit.

RAG on Anthropic returns irrelevant or missing context

4 posts from 4 people on GitHub issues, Reddit.

Anthropic fails to return valid structured output

3 posts from 3 people on GitHub issues.

Trouble with Anthropic inside

Top post: "Agentic run with dynamic filtering (web_search_20260209 inside code_execution) rejected with code_execution", one of 3 posts from 3 people on GitHub issues.

Trouble with Anthropic instead

Top post: "Tool `config: RunnableConfig` parameter receives the parent config instead of the child config, so nested", one of 3 posts from 3 people on GitHub issues.

Anthropic lock-in makes switching costly

3 posts from 3 people on GitHub issues, Hacker News.

Prompt injection makes Anthropic features unsafe

3 posts from 3 people on GitHub issues, Hacker News.

History

First seen with 3 posts; the top post now: "LLM cache stores a generation that fails structured-output parsing and then replays it".

Oct 28, 2026