Benchmark gives confidently wrong answers
2 posts from 1 person1d activeNew, +2 this weekunverified
Posts per day
The posts behind it
veltra pre-execution security guardrails for your agent execution loops
### What would you like to be added? Hey team 👋 When autonomous AI agents execute shell commands or code loops, prompt injections and hallucinations can accidentally run destructive commands (e.g., `rm -rf`, environment secret exfiltration, or unauthorized process spawns). We...
[Feature Request]: Pre-execution security guardrails for your agent execution loops
### Feature Description Hey team 👋 When autonomous AI agents execute shell commands or code loops, prompt injections and hallucinations can accidentally run destructive commands (e.g., `rm -rf`, environment secret exfiltration, or unauthorized process spawns). We built a...
Companies and products named
About this problem
Evidence
2 posts from 1 person in 2 places, about 2 a week over 1 days. Mostly on google-gemini/gemini-cli, run-llama/llama_index. Tools named alongside: Gemini, LlamaIndex.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "hallucination" rule about Benchmark. First post Oct 22, 2026, latest Oct 22, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
LLMs give confidently wrong answers
19 posts from 19 people on Hacker News, Reddit, GitHub issues.
Gemini gives confidently wrong answers
9 posts from 9 people on Reddit, GitHub issues, Hacker News.
Claude gives confidently wrong answers
4 posts from 4 people on Hacker News, App Store reviews.
GitHub Copilot gives confidently wrong answers
3 posts from 3 people on Reddit, GitHub issues.
ChatGPT gives confidently wrong answers
3 posts from 3 people on Reddit, Mastodon, Stack Overflow.
Anthropic gives confidently wrong answers
2 posts from 2 people on GitHub issues. Unverified.
GitHub gives confidently wrong answers
2 posts from 2 people on Hacker News, Reddit. Unverified.
Grok gives confidently wrong answers
2 posts from 2 people on Hacker News, Reddit. Unverified.
Model Context Protocol gives confidently wrong answers
2 posts from 2 people on GitHub issues. Unverified.
OpenAI gives confidently wrong answers
2 posts from 2 people on GitHub issues, Mastodon. Unverified.
Claude Code gives confidently wrong answers
2 posts from 2 people on Reddit. Unverified.
Ollama gives confidently wrong answers
2 posts from 2 people on Reddit, GitHub issues. Unverified.
Other Benchmark problems
Benchmark users keep filing bugs
One post on GitHub issues: "kube-proxy ipvs: read the IPVS service table once per sync". Unverified.
History