Problemsby GlyphLLMs give confidently wrong answers
20 posts from 20 people19d activeSteady, +1 this week
Posts per day
The posts behind it
...went from 47/100 to 100/100 passing - Junban: finds the API response order that breaks a flaky test; caught 6/6 rare races by run 5 vs 2/6 in 3,000 plain reruns - Found ~27s of redundant sleeps in Documenso's E2E suite via the TypeScript Compiler API (fixed upstream) -...
Idea: deterministic tool-call validation step for Workflows (pre-execution, model-independent)
Hi LlamaIndex team, We work on deterministic validation of AI outputs (rules/physics legality). Idea for Workflows: an optional validation step between tool-call events and actual tool execution: - a rules-based gate (allowed tools, argument bounds, resource limits) that is...
Moved from GenAI work to ML/time series forecasting for a higher CTC. How do I rebuild LLM depth and move back?
Background MSc in Data Science, about 1.5 years full-time (closer to 2 with internships). GenAI experience (first year) - AI engineer intern: fine-tuned LLMs for domain-specific QA generation, worked on hallucination reduction and evaluation, fine-tuned ViT/DETR for document...
AI assistant destroys code / Catastrophic file corruption after extended session.
It’s an absolute piece of junk; after you spend hours working on something, it ends up making a catastrophic, irreparable mistake. This is the last time I’ll ever use this garbage of yours. Does this issue occur when all extensions are disabled?: Yes Report Issue' dialog can...
...be made. Edit: why the style is like marketing corp-speak has to do with personalization not working well yet. So the default vanilla style is very corp. Most chatbots allow you to change the system prompt though and that can get rid of a lot of these issues in a lot of...
...of like the pelican test. Every LLM can do a SVG pelican but most of the results are unusable in practice for production/productivity purposes. Every LLm can extract some half-broken SVG hallucination of your jots, but I'm asking for an app that's polished and works accurately...
One example is Affinity 3 released for free. But it's a huge pain in the ass because all the guides for how to do things are for Photoshop or Affinity 2. Your vibecoded app won't have years of reddit posts showing how to do things. This also seems to be where LLMs are the...
...in many cases, my coding agent either failed to disclose what it actually did or found workarounds to things like failed tests instead of telling me upfront. That led me to the idea for Rashomon. Rashomon is an independent execution recorder for coding agents that notifies users...
...pieces don’t fit because there is in fact no puzzle at all. This can leave a reader frustrated: why should they spend more time reading prose than the writer spent writing it?"
Why traditional OCR breaks on unstructured PDFs (and how to build a production pipeline for complex document parsing)
...rate spikes.. Here is the architectural pattern that actually scales when turning messy unstructured documents into reliable, enterprise-grade data pipelines:. 1. Ditch Pure Text Extraction for Hybrid Layout-Aware Parsing . Standard OCR dumps document text as a single linear...
...experience the mind-expanding joy that humans do from using Svelte or the mind-numbing frustration that humans do from using React, but they can inherit the coherent focus of Svelte and incoherent confusion of React without sharing Svelte's pleasure or React's pain.
Has Snowflake CoWork/Cortex Analyst reduced your reliance on Power BI?
...the results?. How well does it interpret business context and questions? Are you still struggling with hallucinations, incorrect joins, or misleading interpretations?. Are you building fewer Power BI dashboards because users can ask questions directly? Do you see this becoming...
...was how bad they were, they don't know what they're doing, the code they write just sucks and they hallucinate APIs. While these criticisms were technically true, they were stated mostly out of a sense of insecurity from people whose jobs were basically spending years and years...
GraphRAG - which problems does it actually solve?
...Vector RAG retrieves chunks that are semantically similar to a query. That can struggle when the answer requires connecting facts spread across multiple documents. A graph gives you explicit entities and relationships that can be traversed or expanded across those connections.....
Again, no one on this thread is claiming that AI "doesn't work." But it's not delusional to say it isn't working in some area, like the legal area. It's hallucinating cases and the law. We see it every week. I had a client tell me they used AI last week and the info it gave them...
And they hallucinate errors in the millions and struggle with financial data that is in a layout that isn’t in the training data. Ie balance sheet etc. Been trying to add more AI to my workflow but it just doesn’t work (yet) - not in the same way as vibe coding does The...
...occurrence. Anti-AI folks have ignorantly painted this as the models being fundamentally unreliable, but you also have a non-zero probability of being struck by lightning or eaten by a shark.
...LLMs for a classification task People out there are so resigned to the models being unreliable that they are really doing things like hallucinating deliberately, and then matching the hallucinations to embeddings - https://softwaredoug.com/blog/2026/08/10/hypothetical-classi......
...themselves are saying that gaming the peer-review system with barrage of AI is extremely frustrating and pointless: Peer review is unpaid work that we do (often on nights and weekends) because peer review on our own work is so valuable. Spending hours going through a submission...
Companies and products named
About this problem
Evidence
20 posts from 20 people in 7 places, about 2 a week over 67 days. Mostly on Hacker News comments, r/RAG, Bluesky search. Tools named alongside: Text, Snowflake, Power BI, VS Code.
Frustration Frustration 2 of 3· Seen on Hacker News, Reddit, GitHub issues, Bluesky
How it was grouped
Posts that state a pain and match the "hallucination" rule. First post Sep 2, 2026, latest Nov 7, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
Gemini gives confidently wrong answers
9 posts from 9 people on Reddit, GitHub issues, Hacker News.
Claude gives confidently wrong answers
5 posts from 5 people on Hacker News, App Store reviews.
GitHub Copilot gives confidently wrong answers
3 posts from 3 people on Reddit, GitHub issues.
ChatGPT gives confidently wrong answers
3 posts from 3 people on Reddit, Mastodon, Stack Overflow.
Claude Code gives confidently wrong answers
3 posts from 3 people on Reddit.
GitHub gives confidently wrong answers
2 posts from 2 people on Hacker News, Reddit. Unverified.
Grok gives confidently wrong answers
2 posts from 2 people on Hacker News, Reddit. Unverified.
Model Context Protocol gives confidently wrong answers
2 posts from 2 people on GitHub issues. Unverified.
OpenAI gives confidently wrong answers
2 posts from 2 people on GitHub issues, Mastodon. Unverified.
Ollama gives confidently wrong answers
2 posts from 2 people on Reddit, GitHub issues. Unverified.
Anthropic gives confidently wrong answers
2 posts from 2 people on GitHub issues. Unverified.
Benchmark gives confidently wrong answers
2 posts from 1 person on GitHub issues. Unverified.
History