Experiments on Codex are hard to reproduce and track

MLOps2 posts from 2 people2d active+11 post in the last 7 days, 0 the 7 days before (steady)Unverified

Posts per day2 posts, Sep 28 to Oct 21

The posts behind it

2, newest first

GitHub issuesOct 16 [BUG] suppress_logging leaves logger levels changed after exit### Bug Description `suppress_logging()` does not restore a logger's configured level when its body raises. A failed ChromaDB search can therefore leave the HNSW logger at `ERROR`, hiding later warnings. Both `ChromaDBClient.search()` and `asearch()` use this helper around the...crewAIInc/crewAI · lakers-abingOpen ↗GitHub issuesSep 28 [Bug]: MarkdownNodeParser closes a code block on a shorter backtick fence...of the 22 failures reports missing NLTK `stopwords` data; the resource downloader is blocked by its network security check in this environment. I am not claiming a clean full-suite result. Related PR [#22123](https://github.com/run-llama/llama_index/pull/22123) is closed without...run-llama/llama_index · galleonliOpen ↗

Companies and products named

LlamaIndex Named1 post

Chroma Named1 post

CrewAI

About this problem

Evidence

2 posts from 2 people in 2 places, about 1 a week over 19 days. Mostly on run-llama/llama_index, crewAIInc/crewAI. Tools named alongside: GitHub, PyPI, LlamaIndex, Chroma.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "ml-reproducibility" rule about Codex. First post Sep 28, 2026, latest Oct 16, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Elsewhere12 postsML experiments are hard to reproduce and track Elsewhere5 postsExperiments on ClickHouse are hard to reproduce and track Elsewhere3 postsExperiments on LlamaIndex are hard to reproduce and track Elsewhere2 postsExperiments on Apache Superset are hard to reproduce and track Elsewhere2 postsExperiments on GitHub are hard to reproduce and track Elsewhere2 postsExperiments on DuckDB are hard to reproduce and track

Other Codex problems

Same product4 postsCodex fails to return valid structured output Same product3 postsTrouble with Codex local Same product33 postsCodex users keep filing bugs Same product7 postsTrouble with Codex windows Same product5 postsTrouble with Codex desktop Same product5 postsCodex rate limits and usage caps block work Same product3 postsCodex runs out of context on real work Same product3 postsTrouble with Codex extension Same product3 postsTrouble with Codex selection Same product3 postsCodex lock-in makes switching costly Same product2 postsCodex outages and slowdowns disrupt work Same product2 postsCodex error messages are cryptic

History

AddedOct 19, 2026Experiments on Codex are hard to reproduce and track (2 posts)