RAG on Ollama returns irrelevant or missing context
LLM apps2 posts from 2 people2d active+11 post in the last 7 days, 1 the 7 days before (steady)Unverified
Posts per day
The posts behind it
2, newest first`ollama._types.ResponseError: Internal Server Error (ref: 67b2fc78-8624-472a-aa7d-0819f65649a3) (status code: 500)`### What is the issue? RAG application crashes when using `gpt-oss:120b-cloud`. ### Relevant log output ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.20.3ollama/ollama · khtehOpen ↗issue: Hybrid-search rerank requests don't forward user info (query_collection drops user)### Before Submitting - [x] I searched open and closed issues and discussions for an existing report. - [x] I reproduced this bug on the latest release AND on the current `dev` branch, right before submitting this report. I did not just check an old version or rely on a check...open-webui/open-webui · rbx4 repliesOpen ↗
Companies and products named
About this problem
Evidence
2 posts from 2 people in 2 places, about 1 a week over 11 days. Mostly on open-webui/open-webui, ollama/ollama. Tools named alongside: Docker, Open WebUI, NVIDIA.
Frustration Frustration 0 of 3· Seen on GitHub issues
How it was grouped
Posts that state a pain and match the "rag-retrieval" rule about Ollama. First post Oct 8, 2026, latest Oct 18, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
RAG retrieval returns irrelevant or missing contextRAG on GitHub returns irrelevant or missing contextRAG on LangChain returns irrelevant or missing contextRAG on Anthropic returns irrelevant or missing contextRAG on vLLM returns irrelevant or missing contextRAG on Claude returns irrelevant or missing contextRAG on PyTorch returns irrelevant or missing contextRAG on Open WebUI returns irrelevant or missing contextRAG on PostgreSQL returns irrelevant or missing contextRAG on Claude Code returns irrelevant or missing contextRAG on SQL Server returns irrelevant or missing contextRAG on LlamaIndex returns irrelevant or missing context
Other Ollama problems
Ollama upgrades break working setupsTrouble with Ollama pullRunning Ollama locally hits memory and speed limitsOllama error messages are crypticTrouble with Ollama chatTrouble with Ollama silentlyOllama users keep filing bugsTrouble with Ollama emptyServing models on Ollama is harder than it should beOllama runs out of context on real workTrouble with Ollama textOllama fails to return valid structured output
History
RAG on Ollama returns irrelevant or missing context (2 posts)