Problemsby GlyphOpenAI fails to return valid structured output
12 posts from 12 people9d activeRising, +3 this week
Posts per day
The posts behind it
[RFC]: Text sessions on /v1/realtime with streaming-input prefill
### Motivation. `/v1/realtime` is transcription only today. It accepts `input_audio_buffer.*` events and works only for models that implement `SupportsRealtime`. Voice agents that run ASR separately and use a text LLM can't use it. These agents get the user's words incrementally...
Python: a tool runs with its defaults when the reply is cut off before any argument is written
## What happens With automatic function calling enabled (`FunctionChoiceBehavior.Auto`), `ChatCompletionClientBase` runs a tool call without looking at `finish_reason`. When the model hits `max_tokens` right after the tool name, the arguments are an empty string; if the...
[Bug]: Bedrock Converse omits strict field for native GPT JSON Schema output
### Description When GPT-6 Luna uses native structured output through Bedrock Converse, LiteLLM translates a strict JSON Schema request into outputConfig.textFormat but omits additionalModelRequestFields.text.format.strict The [AWS GPT-6 Luna model...
issue: non-image files returned by tools never reach the user (MCP blob resources become a text note, data URIs stay as base64 in the chat)
### Before Submitting - [x] I searched open and closed issues and discussions for an existing report. - [x] I reproduced this bug on the latest release AND on the current `dev` branch, right before submitting this report. I did not just check an old version or rely on a check...
core/openai: with `output_version="v1"` and streaming, a tool call with invalid JSON arguments stays a raw `tool_call_chunk` block in `AIMessage.content` and is sent back to Chat Completions
### Submission checklist - [x] This is a bug, not a usage question. - [x] I added a clear and descriptive title that summarizes this issue. - [x] I used the GitHub search to find a similar question and didn't find it. - [x] I am sure that this is a bug in LangChain rather than...
[serve] Streaming error events are not valid JSON when the error message contains quotes
...of the characters in the error message. Currently, clients such as the OpenAI SDK can fail to parse the event and lose the original error behind a JSON decoding error. The fix should use json.dumps({"error": msg}) in all three locations and add a regression test covering quotes...
.Net: Bug: null argument for an optional value-type parameter throws instead of using the default value
**Describe the bug** `KernelFunctionFromMethod` throws `ArgumentOutOfRangeException` when an argument value is `null` and the method parameter is a non-nullable value type with a default value, such as `int count = 5`. The default value is used only when the argument is missing,...
Structured outputs: JSON schema property order lost on the native llama-server chat path (regression of #7978)
### What is the issue? When a JSON schema is passed through `response_format` on the OpenAI-compatible endpoint, the declared order of object properties is not preserved on the native llama-server chat path: the model is constrained to emit keys in **alphabetical order**. For...
Tracing records multimodal prompt JSON as a text part
## Description The tracing shape added in #7464 mishandles OpenAI-compatible multimodal input messages. When `message["content"]` is a list of content blocks, `_input_msg()` passes the entire list through `_to_str()` and wraps it in one OpenTelemetry text part. For this input:...
[BUG] Gemini 3 broke multi-turn function calling on the OpenAI-compatible path: thoughtSignature moved from functionCall to the Part object
> [!WARNING] > Before submitting a PR, please make sure that: > - A maintainer has triaged this issue and applied the `ready` label > - This issue has no assignee > - No duplicate PR exists > > PRs not meeting these requirements may be automatically closed. ### Issues Policy...
...most straightforward ways of interacting with LLMs via http. To the point that they got stuck with this legacy thing now that they and many others keeps reasoning traces private on their servers, which actually hinders future adoption. If they had forced their function calling...
[Documentation]: PZERO OpenAILike example
### Documentation Issue Description The OpenAILike page (https://developers.llamaindex.ai/python/framework-api-reference/llms/openai_like/) shows a generic hostname example. A named PZERO example would let people point LlamaIndex agents at prepaid inference without guessing...
Companies and products named
About this problem
Evidence
12 posts from 12 people in 11 places, about 1 a week over 71 days. Mostly on microsoft/semantic-kernel, Hacker News comments, run-llama/llama_index. Tools named alongside: Ollama, PyPI, GitHub, Hugging Face.
Frustration Frustration 0 of 3· Seen on GitHub issues, Hacker News
How it was grouped
Posts that state a pain and match the "structured-output" rule about OpenAI. First post Aug 28, 2026, latest Nov 6, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
Models fail to return valid structured output
15 posts from 13 people on GitHub issues, Hacker News.
Claude fails to return valid structured output
10 posts from 8 people on GitHub issues.
Codex fails to return valid structured output
6 posts from 3 people on GitHub issues.
Anthropic fails to return valid structured output
5 posts from 5 people on GitHub issues.
LlamaIndex fails to return valid structured output
5 posts from 5 people on GitHub issues.
Model Context Protocol fails to return valid structured output
5 posts from 5 people on GitHub issues, Reddit.
Ollama fails to return valid structured output
4 posts from 3 people on GitHub issues.
vLLM fails to return valid structured output
3 posts from 3 people on GitHub issues.
GitHub fails to return valid structured output
3 posts from 3 people on GitHub issues.
Gemini fails to return valid structured output
3 posts from 3 people on GitHub issues, Reddit.
Hugging Face fails to return valid structured output
2 posts from 2 people on Reddit, GitHub issues. Unverified.
LangChain fails to return valid structured output
2 posts from 2 people on GitHub issues. Unverified.
Other OpenAI problems
Trouble with OpenAI responses
Top post: "completion_cost() raises ModelNotMappedError for groq/openai/gpt-oss-* responses, even when model=groq/... is", one of 18 posts from 16 people on GitHub issues, Community forums.
OpenAI runs out of context on real work
8 posts from 8 people on GitHub issues, Community forums.
OpenAI users keep asking for help
Top post: "Multi-file uploads failing and ZIP archives not parsing / sandbox timeout (100% Limits Remaining)", one of 49 posts from 47 people on Community forums, GitHub issues, Reddit.
Trouble with OpenAI assistant
Top post: "Bedrock Converse forwards OpenAI-style content parts in user and assistant messages unconverted", one of 3 posts from 3 people on GitHub issues.
OpenAI rate limits and usage caps block work
6 posts from 6 people on GitHub issues, Community forums.
Running OpenAI locally hits memory and speed limits
13 posts from 13 people on GitHub issues.
Trouble with OpenAI calls
Top post: "Unable to connect to dot calls across mobile, web and desktop", one of 7 posts from 6 people on GitHub issues, Community forums.
OpenAI upgrades break working setups
25 posts from 25 people on GitHub issues, Reddit, Community forums.
Trouble with OpenAI chat
Top post: "Chat attachments inside Projects intermittently fail to materialize into /mnt/data, while File Library and", one of 12 posts from 12 people on Community forums, GitHub issues, Reddit.
Trouble with OpenAI image
Top post: "Image generation is broken for serious work", one of 8 posts from 8 people on GitHub issues, Community forums, Reddit.
Trouble with OpenAI decisions
Top post: "OpenAI Decisions API", one of 6 posts from 4 people on GitHub issues.
Trouble with OpenAI reasoning
Top post: "glm-5.3 can enter endless reasoning and eventually abort tasks in both OpenCode and ZCode, while official", one of 5 posts from 5 people on GitHub issues.
History