Data and AI struggles

1,730 problems · 342 companies

LLM apps

Hugging Face fails to return valid structured output

2 posts from 2 people2d activeSteady, +1 this weekunverified

Posts per day

Posts per day2 posts, Sep 24 to Nov 9

The posts behind it

GitHub issueshuggingface/transformers · BlazeSR10hawkNov 5

Tool schemas silently dropped during response parsing across text, multimodal pipelines and serving APIs

## System Info - Transformers: `5.23.0.dev0` - Commit: `62dd93e125d28fc8e1cdf6424783f5dc27762c63` - Platform: Linux 6.18.55+, x86_64, glibc 2.39 - Python: 3.13.16 - PyTorch: 2.11.0+cu130 - GPU: Tesla T4 (reproduction runs on CPU) - Hugging Face Hub: 1.33.0 - Accelerate: 1.15.0 -...

4 replies
Redditr/LocalLLaMA · u/R_DuncanSep 24

JEV almost dead: CLM vs JEV

...performance on Terminal-Bench 2.1 (87.6%) and DeepSWE (81.6%) , whereas zero-shot Jev struggled on those exact benchmarks (scoring ~71% on DeepSWE).. 3. Where Jev Still Has the Edge (CLM-8B Limitations) While CLM covers the entire feature surface of Jev, the current CLM-v0.1-8B...

Companies and products named

1 post
1 post
1 post
About this problem

Evidence

2 posts from 2 people in 2 places, about 1 a week over 43 days. Mostly on r/LocalLLaMA, huggingface/transformers. Tools named alongside: GitHub, PyTorch, Tesla.

Frustration Frustration 0 of 3· Seen on Reddit, GitHub issues

How it was grouped

Posts that state a pain and match the "structured-output" rule about Hugging Face. First post Sep 24, 2026, latest Nov 5, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

Models fail to return valid structured output

15 posts from 13 people on GitHub issues, Hacker News.

OpenAI fails to return valid structured output

12 posts from 12 people on GitHub issues, Hacker News.

Claude fails to return valid structured output

10 posts from 8 people on GitHub issues.

Codex fails to return valid structured output

6 posts from 3 people on GitHub issues.

Anthropic fails to return valid structured output

5 posts from 5 people on GitHub issues.

LlamaIndex fails to return valid structured output

5 posts from 5 people on GitHub issues.

Model Context Protocol fails to return valid structured output

5 posts from 5 people on GitHub issues, Reddit.

Ollama fails to return valid structured output

4 posts from 3 people on GitHub issues.

vLLM fails to return valid structured output

3 posts from 3 people on GitHub issues.

GitHub fails to return valid structured output

3 posts from 3 people on GitHub issues.

Gemini fails to return valid structured output

3 posts from 3 people on GitHub issues, Reddit.

LangChain fails to return valid structured output

2 posts from 2 people on GitHub issues. Unverified.

Other Hugging Face problems

Hugging Face upgrades break working setups

14 posts from 13 people on GitHub issues, Reddit, Community forums.

Running Hugging Face locally hits memory and speed limits

17 posts from 15 people on GitHub issues, Reddit.

Fine-tuning Hugging Face is costly and unpredictable

9 posts from 9 people on GitHub issues, Reddit.

Trouble with Hugging Face fail

Top post: "All paid GPU pools fail to start: MOUNT_ATTR_IDMAP error at container init (Exit code 128)", one of 8 posts from 5 people on GitHub issues, Community forums.

Trouble with Hugging Face generate

Top post: "prefill_chunk_size drops image inputs, VLMs generate without the image", one of 6 posts from 5 people on GitHub issues, Community forums.

Trouble with Hugging Face token

Top post: "<|image|> token has special=False in Rust tokenizer backend, should it be True?", one of 4 posts from 4 people on GitHub issues.

Trouble with Hugging Face logits

Top post: "`DogeCDMoE` router `.view(2, bsz * seq_len, -1)` mixes tokens: with `is_moe=True`, logits depend on future", one of 4 posts from 4 people on GitHub issues.

Trouble with Hugging Face docs

Top post: "Translating docs to <languageName>", one of 4 posts from 3 people on GitHub issues.

Trouble with Hugging Face torch

Top post: "import transformers spends 1-3 s in an eager importlib.metadata.packages_distributions() when torch >= 2.14", one of 4 posts from 4 people on GitHub issues.

Trouble with Hugging Face load

Top post: "gemma 4 can not load audio file and produce Audio features and audio tokens do not match, tokens: 31,", one of 3 posts from 3 people on GitHub issues.

Trouble with Hugging Face chat

Top post: "Chat parsing: `json` parser's `string_delims` doesn't handle escaped delimiters", one of 3 posts from 3 people on GitHub issues, Community forums.

Hugging Face runs out of context on real work

3 posts from 3 people on GitHub issues.

History

First seen with 2 posts.

Nov 7, 2026