Data and AI struggles

1,730 problems · 342 companies

LLM apps

Trouble with Anthropic response

4 posts from 4 people4d activeSteady, +1 this week

Posts per day

Posts per day4 posts, Sep 24 to Nov 9

The posts behind it

GitHub issuesBerriAI/litellm · alpaylanNov 3

[Bug]: Cached responses() call on an Anthropic model fails with "provider returned a response with no 'choices'"

### Description With the response cache on, `litellm.responses()` on a model that goes through the Responses to chat completions bridge (here `anthropic/`) works the first time and stores the response. The same call a second time is a cache hit and raises `litellm.APIError:...

1 replies
GitHub issueslangchain-ai/langchain · Jingyi-A-ChenOct 26

mistralai: an error event inside a chat stream is silently dropped, and the truncated output is returned as a successful response

### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...

2 replies
GitHub issueslangchain-ai/langchain · popotamOct 25

_generate_response_from_error leaves an unawaited coroutine when the error's response comes from an async HTTP client

### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...

1 replies
GitHub issueslangchain-ai/langchain · kimnamuSep 24

create_agent with response_format loops or returns 400 for Bedrock GPT-6 model IDs because `gpt-6` is missing from the structured-output fallback list

### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...

1 replies

Companies and products named

4 posts
3 posts
3 posts
3 posts
3 posts
About this problem

Evidence

4 posts from 4 people in 2 places, about 1 a week over 41 days. Mostly on langchain-ai/langchain, BerriAI/litellm. Tools named alongside: Perplexity, DeepSeek, Ollama, Hugging Face.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts about Anthropic with no known issue, sharing the word "response". First post Sep 24, 2026, latest Nov 3, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

Other Anthropic problems

Anthropic users keep filing bugs

Top post: "`HTMLHeaderTextSplitter` raises `ValueError` on init for the non-heading tags its splitter already supports", one of 36 posts from 33 people on GitHub issues, App Store reviews, Reddit.

Anthropic upgrades break working setups

27 posts from 22 people on GitHub issues.

Anthropic rate limits and usage caps block work

12 posts from 9 people on GitHub issues, Reddit, Community forums.

Trouble with Anthropic core

Top post: "core: parse_json_markdown returns the wrong value for a json5 fence and fails on other fence tags", one of 8 posts from 6 people on GitHub issues.

Anthropic token costs are hard to predict

6 posts from 6 people on Hacker News, GitHub issues, Reddit.

Trouble with Anthropic cache

Top post: "LLM cache stores a generation that fails structured-output parsing and then replays it", one of 6 posts from 6 people on GitHub issues.

Trouble with Anthropic messages

Top post: "/v1/messages: client disconnect before the first chunk leaves the upstream LLM request running", one of 6 posts from 6 people on GitHub issues.

Anthropic fails to return valid structured output

5 posts from 5 people on GitHub issues.

RAG on Anthropic returns irrelevant or missing context

5 posts from 5 people on GitHub issues, Reddit.

Anthropic runs out of context on real work

4 posts from 4 people on GitHub issues.

Anthropic pricing is too high or keeps changing

3 posts from 3 people on Hacker News, Reddit.

Prompt injection makes Anthropic features unsafe

3 posts from 3 people on GitHub issues, Hacker News.

History

Corroborated: 3 or more posts from 2 or more people or places.

Nov 8, 2026

Momentum went from fading to steady.

Nov 8, 2026

Momentum went from new to fading.

Nov 1, 2026

First seen with 1 post; the top post now: "mistralai: an error event inside a chat stream is silently dropped, and the truncated output is returned as a".

Oct 28, 2026