Data and AI struggles

2,114 problems · 377 companies

MLOps

Experiments on LlamaIndex are hard to reproduce and track

3 posts from 3 people3d activeFading, +0 this week

Posts per day

Posts per day3 posts, Sep 19 to Nov 21

The posts behind it

GitHub issuesrun-llama/llama_index · yifanxiong272Oct 14

[Bug]: Restoring a context loses an event a list join already holds, when it came from a nested fan-out restored while waiting

### Bug Description A run that is idle and waiting for human input is saved with `ctx.to_dict()` and restored into a fresh workflow instance with `Context.from_dict(...)`, as after a process restart. After a restore, the run can lose an event that a list join has already...

3 replies
GitHub issuesrun-llama/llama_index · takagibit18Oct 2

[Bug]: SimpleFileNodeParser ignores custom id_func for supported file types

## Bug Description Setting id_func on SimpleFileNodeParser has no effect when it delegates to MarkdownNodeParser, JSONNodeParser or HTMLNodeParser. The nodes get the child parser's default UUIDs. The fallback path already uses the custom callback. The callback should receive the...

GitHub issuesrun-llama/llama_index · BlueX888Sep 19

[Bug]: stream_structured_predict / astream_structured_predict raise UnboundLocalError instead of yielding nothing when the partial stream is empty

### Bug Description `LLM.stream_structured_predict` (llama-index-core/llama_index/core/llms/llm.py:461) and its async twin `LLM.astream_structured_predict` (llm.py:539) emit their terminal instrumentation event with the loop variable, *after* the loop that binds it: The async...

Companies and products named

3 posts
About this problem

Evidence

3 posts from 3 people in 1 place, about 1 a week over 26 days. Mostly on run-llama/llama_index.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "ml-reproducibility" rule about LlamaIndex. First post Sep 19, 2026, latest Oct 14, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

The same problem elsewhere

ML experiments are hard to reproduce and track

21 posts from 19 people on GitHub issues, Reddit, Hacker News.

Experiments on DuckDB are hard to reproduce and track

11 posts from 7 people on GitHub issues.

Experiments on ClickHouse are hard to reproduce and track

11 posts from 2 people on GitHub issues.

Experiments on MLflow are hard to reproduce and track

4 posts from 4 people on GitHub issues.

Experiments on Codex are hard to reproduce and track

4 posts from 3 people on GitHub issues.

Experiments on GitHub are hard to reproduce and track

3 posts from 3 people on GitHub issues, Reddit.

Experiments on llama.cpp are hard to reproduce and track

3 posts from 3 people on GitHub issues.

Experiments on OpenAI are hard to reproduce and track

2 posts from 2 people on GitHub issues. Unverified.

Experiments on Apache Superset are hard to reproduce and track

2 posts from 1 person on GitHub issues. Unverified.

Experiments on SQLite are hard to reproduce and track

2 posts from 2 people on GitHub issues. Unverified.

Other LlamaIndex problems

LlamaIndex upgrades break working setups

19 posts from 12 people on GitHub issues.

LlamaIndex users keep filing bugs

Top post: "SQLAlchemyChatStore.delete_message treats positional index as database primary key", one of 13 posts from 8 people on GitHub issues, Stack Overflow.

RAG on LlamaIndex returns irrelevant or missing context

5 posts from 5 people on GitHub issues.

LlamaIndex fails to return valid structured output

5 posts from 5 people on GitHub issues.

Trouble with LlamaIndex json

Top post: "JSONNodeParser emits empty-text nodes for {} and misreports valid scalar JSON as invalid", one of 3 posts from 3 people on GitHub issues.

Trouble with LlamaIndex returns

Top post: "LegacyOfficeReader returns a Document with text None for a document with no text", one of 3 posts from 3 people on GitHub issues.

LlamaIndex vector search quality is hard to get right

3 posts from 3 people on GitHub issues.

Trouble with LlamaIndex functiontool

Top post: "FunctionTool wraps a returned ToolOutput as a success and drops is_error", one of 3 posts from 3 people on GitHub issues.

LlamaIndex runs out of context on real work

3 posts from 2 people on GitHub issues.

Trouble with LlamaIndex documents

Top post: "MoorchehVectorStore sparse-vector path raises NameError (missing imports, undefined 'documents', ImpotError", one of 3 posts from 3 people on GitHub issues.

Trouble with LlamaIndex default

Top post: "max_iterations=0 is silently replaced by the default 20", one of 3 posts from 3 people on GitHub issues.

Trouble with LlamaIndex documentation

Top post: "The API documentation cannot be used properly and cannot be scrolled to see more content", one of 3 posts from 3 people on GitHub issues.

History

Momentum went from steady to fading.

Oct 21, 2026

Corroborated: 3 or more posts from 2 or more people or places.

Oct 19, 2026

Momentum went from fading to steady.

Oct 19, 2026

Momentum went from steady to fading.

Oct 9, 2026

First seen with 2 posts.

Oct 4, 2026