Problemsby GlyphExperiments on OpenAI are hard to reproduce and track
2 posts from 2 people2d activeSteady, +1 this weekunverified
Posts per day
The posts behind it
Bug: Disabled models remain accessible in existing chats and continue generating API charges (v0.12.4)
### Before Submitting - [x] I searched open and closed issues and discussions for an existing report. - [x] I reproduced this bug on the latest release AND on the current `dev` branch, right before submitting this report. I did not just check an old version or rely on a check...
[BUG] AI Gateway: `send_stream_request` drops the upstream error message unless the body is OpenAI-shaped
> [!WARNING] > Before submitting a PR, please make sure that: > - A maintainer has triaged this issue and applied the `ready` label > - This issue has no assignee > - No duplicate PR exists > > PRs not meeting these requirements may be automatically closed. ### Issues Policy...
Companies and products named
About this problem
Evidence
2 posts from 2 people in 2 places, about 1 a week over 50 days. Mostly on mlflow/mlflow, open-webui/open-webui. Tools named alongside: Claude, MLflow, Amazon Bedrock, GitHub.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "ml-reproducibility" rule about OpenAI. First post Sep 16, 2026, latest Nov 4, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
ML experiments are hard to reproduce and track
17 posts from 15 people on GitHub issues, Reddit, Hacker News.
Experiments on ClickHouse are hard to reproduce and track
8 posts from 1 person on GitHub issues. Unverified.
Experiments on DuckDB are hard to reproduce and track
6 posts from 4 people on GitHub issues.
Experiments on Codex are hard to reproduce and track
4 posts from 3 people on GitHub issues.
Experiments on LlamaIndex are hard to reproduce and track
3 posts from 3 people on GitHub issues.
Experiments on MLflow are hard to reproduce and track
3 posts from 3 people on GitHub issues.
Experiments on GitHub are hard to reproduce and track
3 posts from 3 people on GitHub issues, Reddit.
Experiments on llama.cpp are hard to reproduce and track
2 posts from 2 people on GitHub issues. Unverified.
Experiments on Apache Superset are hard to reproduce and track
2 posts from 1 person on GitHub issues. Unverified.
Other OpenAI problems
Trouble with OpenAI responses
Top post: "completion_cost() raises ModelNotMappedError for groq/openai/gpt-oss-* responses, even when model=groq/... is", one of 18 posts from 16 people on GitHub issues, Community forums.
OpenAI runs out of context on real work
8 posts from 8 people on GitHub issues, Community forums.
OpenAI fails to return valid structured output
12 posts from 12 people on GitHub issues, Hacker News.
OpenAI users keep asking for help
Top post: "Multi-file uploads failing and ZIP archives not parsing / sandbox timeout (100% Limits Remaining)", one of 49 posts from 47 people on Community forums, GitHub issues, Reddit.
Trouble with OpenAI assistant
Top post: "Bedrock Converse forwards OpenAI-style content parts in user and assistant messages unconverted", one of 3 posts from 3 people on GitHub issues.
OpenAI rate limits and usage caps block work
6 posts from 6 people on GitHub issues, Community forums.
Running OpenAI locally hits memory and speed limits
13 posts from 13 people on GitHub issues.
Trouble with OpenAI calls
Top post: "Unable to connect to dot calls across mobile, web and desktop", one of 7 posts from 6 people on GitHub issues, Community forums.
OpenAI upgrades break working setups
25 posts from 25 people on GitHub issues, Reddit, Community forums.
Trouble with OpenAI chat
Top post: "Chat attachments inside Projects intermittently fail to materialize into /mnt/data, while File Library and", one of 12 posts from 12 people on Community forums, GitHub issues, Reddit.
Trouble with OpenAI image
Top post: "Image generation is broken for serious work", one of 8 posts from 8 people on GitHub issues, Community forums, Reddit.
Trouble with OpenAI decisions
Top post: "OpenAI Decisions API", one of 6 posts from 4 people on GitHub issues.
History