Data and AI struggles

1,512 problems · 320 companies

LLM apps

Codex quality feels worse after updates

2 posts from 2 people2d activeSteady, +1 this weekunverified

Posts per day

Posts per day2 posts, Sep 22 to Nov 3

The posts behind it

Redditr/AI_Agents · u/ombre-aiNov 2

Google's agent team says test discrete behaviors, not just benchmark scores. How do you catch an agent getting worse after a prompt, tool or model change?

...harness engineering post attacks the same problem from the build side. When the agent struggled, they treated it as a missing capability and fed the fix back into the repo as docs, guardrails or tooling.. Both are about coding agents with specific tooling, so I don't know how...

Companies and products named

2 posts
1 post
1 post
1 post
About this problem

Evidence

2 posts from 2 people in 2 places, about 1 a week over 42 days. Mostly on Hacker News comments, r/AI_Agents. Tools named alongside: Cursor, JetBrains, Harness.

Frustration Frustration 3 of 3· Seen on Hacker News, Reddit

How it was grouped

Posts that state a pain and match the "model-regression" rule about Codex. First post Sep 22, 2026, latest Nov 2, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Model quality silently gets worse between versions

11 posts from 11 people on Reddit, Hacker News, Bluesky.

Claude quality feels worse after updates

3 posts from 3 people on Hacker News, App Store reviews, Reddit.

Slack quality feels worse after updates

2 posts from 2 people on App Store reviews. Unverified.

Other Codex problems

Codex runs out of context on real work

5 posts from 5 people on GitHub issues, Reddit, Hacker News.

Codex rate limits and usage caps block work

13 posts from 13 people on GitHub issues.

Codex plans, limits and pricing keep changing

5 posts from 5 people on GitHub issues, Stack Overflow.

Codex users keep filing bugs

Top post: "Turn off whimsy effect (astra stars) by default", one of 35 posts from 34 people on GitHub issues, Reddit, Community forums.

Trouble with Codex windows

Top post: "dot-started local tasks lack Computer Use tools while ordinary local Codex sessions work", one of 10 posts from 10 people on GitHub issues, Community forums.

Codex fails to return valid structured output

6 posts from 3 people on GitHub issues.

Trouble with Codex desktop

Top post: "Editing and resending a queued message triggers App-server queued follow-up no longer exists", one of 5 posts from 5 people on GitHub issues.

Codex tables suffer from small files and skew

4 posts from 4 people on GitHub issues.

Trouble with Codex local

Top post: "Dot cannot create or follow up with local Codex tasks in saved projects", one of 4 posts from 4 people on GitHub issues, Community forums.

Codex outages and slowdowns disrupt work

3 posts from 3 people on Hacker News, GitHub issues.

Trouble with Codex silently

Top post: "/api/codex/v1/responses silently returns empty completion for previous_response_id tool follow-up", one of 3 posts from 3 people on GitHub issues.

Trouble with Codex extension

Top post: "VS Code extension: GPT-6.1 Sol missing from model picker, available in Codex App and CLI", one of 3 posts from 3 people on GitHub issues.

History

First seen with 2 posts.

Nov 3, 2026