Data and AI struggles

2,114 problems · 377 companies

Data engineering

Claude Code tables suffer from small files and skew

9 posts from 9 people8d activeFading, +0 this week

Posts per day

Posts per day8 posts, Aug 30 to Nov 21

The posts behind it

latest 8 of 9
GitHub issuespola-rs/polars · djouallahOct 22

Iceberg: compact small data files

### Description I would like a Polars way to compact an Iceberg table: rewrite its small data files into fewer large ones, in one replace commit, without changing the rows. On `main` (`fd703335f7`), Polars' Iceberg API is `scan_iceberg`, `LazyFrame.sink_iceberg`,...

1 replies
GitHub issuesanthropics/claude-code · winnalOct 17

[Feature Request] Add idle compaction support to desktop app Code tab sessions

**Bug Description** Feature request: idle compaction in the desktop app’s Code tab. The settings reference says idle compaction (idleCompaction, on by default, threshold CLAUDE_CODE_IDLE_COMPACT_MIN_TOKENS = 200,000) only applies to interactive terminal sessions. Long-running...

2 reactions1 replies
Redditr/ClaudeAI · u/skynet86Oct 15

Opus 5.5 does not follow rules

...that if there is no mechanic that forces it to follow them, it won't. It's a little bit frustrating. How do you guys do that? Move most of the stuff to skills which is getting activated just in time?. Its coming from a 20 hours long refactoring session, split up in multiple...

GitHub issuesanthropics/claude-code · tylerlapradeOct 9

[BUG] Idle '/clear to save tokens' hint waits 75 minutes, but the 1-hour prompt cache is usually gone by 62

...idle, or time it from the cache's own expiry, which idle compaction already tracks. ### Workaround `CLAUDE_CODE_IDLE_THRESHOLD_MINUTES=60` in the `env` block of settings. The variable is undocumented. ### Environment Claude Code 2.1.295, macOS (Darwin 24.6.0), Claude...

1 reactions
GitHub issuesanthropics/claude-code · lucyseven-botOct 2

Composer prompt suggestions (ghost text, Tab to accept) stopped appearing in the desktop app while the setting stays On

...to false per account, with no local override. Is this the same cause here? If so, is there any way for a user to see the gate state, rather than the feature silently disappearing?

2 reactions2 replies
GitHub issuesanthropics/claude-code · natefosterwarnerOct 1

[BUG] 2.1.286 idle compaction silently discards working context in long-running sessions; no opt-out, logged as "manual"

...makes them indistinguishable from user-initiated compactions, which makes the behavior hard to diagnose. 2. **No documented hook.** I couldn't find documentation confirming that `PreCompact` fires for idle compaction, which would let users save state first. ## Suggested fixes 1....

10 reactions11 replies
GitHub issuesanthropics/claude-code · noboru007Oct 1

[MODEL] Claude Opus 5.5 behavior shift starting 2026-10-01: ~2x thinking, ~1.6x output, worse judgment — also observed outside Claude Code

### Summary Starting 2026-10-01 (UTC), Claude Opus 5.5 in Claude Code shows a statistically significant change in behavior with no change on my side: more thinking tokens and longer outputs per request, together with clearly worse task judgment. The same kind of unreliability...

2 reactions6 replies
GitHub issuesanthropics/claude-code · ewokeeAug 30

Desktop app: bring back the context-usage indicator (or make the footer widget configurable)

The desktop app's bottom-right footer currently shows the 5-hour usage-limit ring. Earlier builds showed context-window usage there. For long agentic sessions the context number is the more actionable one (am I approaching compaction?), while the usage ring rarely changes any...

9 reactions7 replies

Companies and products named

6 posts
3 posts
1 post
1 post
About this problem

Evidence

9 posts from 9 people in 3 places, about 1 a week over 67 days. Mostly on anthropics/claude-code, r/ClaudeAI, pola-rs/polars. Tools named alongside: Claude, GitHub, Codex, Apache Iceberg.

Frustration Frustration 2 of 3· Seen on GitHub issues, Reddit

How it was grouped

Posts that state a pain and match the "file-formats" rule about Claude Code. First post Aug 30, 2026, latest Nov 4, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

The same problem elsewhere

Small files, skew and partitioning hurt performance

17 posts from 16 people on GitHub issues, Hacker News.

ChatGPT tables suffer from small files and skew

6 posts from 6 people on GitHub issues.

GitHub tables suffer from small files and skew

5 posts from 5 people on GitHub issues.

Databricks tables suffer from small files and skew

4 posts from 4 people on Reddit, GitHub issues.

Codex tables suffer from small files and skew

4 posts from 4 people on GitHub issues.

Claude tables suffer from small files and skew

4 posts from 4 people on GitHub issues, Hacker News.

Docker tables suffer from small files and skew

3 posts from 3 people on GitHub issues, Hacker News.

OpenAI tables suffer from small files and skew

3 posts from 3 people on GitHub issues.

Mistral tables suffer from small files and skew

2 posts from 2 people on GitHub issues. Unverified.

llama.cpp tables suffer from small files and skew

2 posts from 2 people on GitHub issues. Unverified.

Apache Flink tables suffer from small files and skew

2 posts from 2 people on GitHub issues. Unverified.

Other Claude Code problems

Trouble with Claude Code session

Top post: "Remote Control (mobile): session start cards / task chips not shown on the phone; start_session refused for", one of 9 posts from 9 people on GitHub issues.

Trouble with Claude Code slower

Top post: "CPU torch.topk slower than expected for contiguous small k over a large dimension", one of 5 posts from 3 people on GitHub issues.

Claude Code deprecations force unplanned migrations

6 posts from 5 people on GitHub issues.

Claude Code outages and slowdowns disrupt work

28 posts from 28 people on Glyph Ibis, GitHub issues, Hacker News.

Claude Code upgrades break working setups

82 posts from 73 people on GitHub issues, Hacker News, Reddit.

Claude Code users keep filing bugs

Top post: "Bug Report: Privacy violation in User-Agent header", one of 46 posts from 43 people on GitHub issues, Reddit.

Trouble with Claude Code desktop

Top post: "Desktop app disallows SendMessage, so subagents cannot be messaged or resumed", one of 24 posts from 24 people on GitHub issues, Reddit.

Claude Code rate limits and usage caps block work

22 posts from 22 people on GitHub issues, Reddit, Hacker News.

Claude Code lock-in makes switching costly

16 posts from 16 people on GitHub issues, Hacker News, Reddit.

Claude Code runs out of context on real work

13 posts from 13 people on GitHub issues, Reddit, Hacker News.

Claude Code plans, limits and pricing keep changing

10 posts from 10 people on GitHub issues, App Store reviews, Reddit.

Trouble with Claude Code agent

Top post: "Agent repeatedly ignored explicit environment/branch instructions, modified the wrong branch and the user's", one of 8 posts from 8 people on GitHub issues, Reddit.

History

Momentum went from fading to steady.

Oct 15, 2026

Momentum went from steady to fading.

Oct 9, 2026

Momentum went from rising to steady.

Oct 8, 2026

First seen with 4 posts.

Oct 5, 2026