Experiments on LlamaIndex are hard to reproduce and track
3 posts from 3 people3d activeFading, +0 this week
Posts per day
The posts behind it
[Bug]: Restoring a context loses an event a list join already holds, when it came from a nested fan-out restored while waiting
### Bug Description A run that is idle and waiting for human input is saved with `ctx.to_dict()` and restored into a fresh workflow instance with `Context.from_dict(...)`, as after a process restart. After a restore, the run can lose an event that a list join has already...
[Bug]: SimpleFileNodeParser ignores custom id_func for supported file types
## Bug Description Setting id_func on SimpleFileNodeParser has no effect when it delegates to MarkdownNodeParser, JSONNodeParser or HTMLNodeParser. The nodes get the child parser's default UUIDs. The fallback path already uses the custom callback. The callback should receive the...
[Bug]: stream_structured_predict / astream_structured_predict raise UnboundLocalError instead of yielding nothing when the partial stream is empty
### Bug Description `LLM.stream_structured_predict` (llama-index-core/llama_index/core/llms/llm.py:461) and its async twin `LLM.astream_structured_predict` (llm.py:539) emit their terminal instrumentation event with the loop variable, *after* the loop that binds it: The async...
Companies and products named
About this problem
Evidence
3 posts from 3 people in 1 place, about 1 a week over 26 days. Mostly on run-llama/llama_index.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "ml-reproducibility" rule about LlamaIndex. First post Sep 19, 2026, latest Oct 14, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
ML experiments are hard to reproduce and track
21 posts from 19 people on GitHub issues, Reddit, Hacker News.
Experiments on DuckDB are hard to reproduce and track
11 posts from 7 people on GitHub issues.
Experiments on ClickHouse are hard to reproduce and track
11 posts from 2 people on GitHub issues.
Experiments on MLflow are hard to reproduce and track
4 posts from 4 people on GitHub issues.
Experiments on Codex are hard to reproduce and track
4 posts from 3 people on GitHub issues.
Experiments on GitHub are hard to reproduce and track
3 posts from 3 people on GitHub issues, Reddit.
Experiments on llama.cpp are hard to reproduce and track
3 posts from 3 people on GitHub issues.
Experiments on OpenAI are hard to reproduce and track
2 posts from 2 people on GitHub issues. Unverified.
Experiments on Apache Superset are hard to reproduce and track
2 posts from 1 person on GitHub issues. Unverified.
Experiments on SQLite are hard to reproduce and track
2 posts from 2 people on GitHub issues. Unverified.
Other LlamaIndex problems
LlamaIndex upgrades break working setups
19 posts from 12 people on GitHub issues.
LlamaIndex users keep filing bugs
Top post: "SQLAlchemyChatStore.delete_message treats positional index as database primary key", one of 13 posts from 8 people on GitHub issues, Stack Overflow.
RAG on LlamaIndex returns irrelevant or missing context
5 posts from 5 people on GitHub issues.
LlamaIndex fails to return valid structured output
5 posts from 5 people on GitHub issues.
Trouble with LlamaIndex json
Top post: "JSONNodeParser emits empty-text nodes for {} and misreports valid scalar JSON as invalid", one of 3 posts from 3 people on GitHub issues.
Trouble with LlamaIndex returns
Top post: "LegacyOfficeReader returns a Document with text None for a document with no text", one of 3 posts from 3 people on GitHub issues.
LlamaIndex vector search quality is hard to get right
3 posts from 3 people on GitHub issues.
Trouble with LlamaIndex functiontool
Top post: "FunctionTool wraps a returned ToolOutput as a success and drops is_error", one of 3 posts from 3 people on GitHub issues.
LlamaIndex runs out of context on real work
3 posts from 2 people on GitHub issues.
Trouble with LlamaIndex documents
Top post: "MoorchehVectorStore sparse-vector path raises NameError (missing imports, undefined 'documents', ImpotError", one of 3 posts from 3 people on GitHub issues.
Trouble with LlamaIndex default
Top post: "max_iterations=0 is silently replaced by the default 20", one of 3 posts from 3 people on GitHub issues.
Trouble with LlamaIndex documentation
Top post: "The API documentation cannot be used properly and cannot be scrolled to see more content", one of 3 posts from 3 people on GitHub issues.
History