Data and AI struggles

2,114 problems · 377 companies

Cloud and tool cost

GitHub token costs are hard to predict

2 posts from 2 people2d activeSteady, +1 this weekunverified

Posts per day

Posts per day2 posts, Oct 8 to Nov 21

The posts behind it

GitHub issuesBerriAI/litellm · emerzonNov 15

[Bug] Token-priced rerank calls calculate zero cost despite reported input tokens

### Description Token-priced rerank responses calculate a cost of zero even when the response reports input tokens and the resolved model has a nonzero `input_cost_per_token`. A per-query control using the same public calculator returns the configured cost. The current catalog...

Redditr/mlops · u/sricheruOct 8

[P] Open-Sourcing a sub-15ms Deterministic Decision Gateway to eliminate 2-second LLM routing latencies (FastAPI/Python)

...decisions (e.g., safety guardrails or API triage). Token generation is inherently too slow and expensive for operational routing.. To solve this at scale, I built and open-sourced the "Dual-Process Jev Gateway.". It places a sub-15ms deterministic decision layer (System 1) in...

Companies and products named

2 posts
1 post
About this problem

Evidence

2 posts from 2 people in 2 places, about 1 a week over 39 days. Mostly on r/mlops, BerriAI/litellm. Tools named alongside: BerriAI.

Frustration Frustration 0 of 3· Seen on Reddit, GitHub issues

How it was grouped

Posts that state a pain and match the "llm-cost" rule about GitHub. First post Oct 8, 2026, latest Nov 15, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

The same problem elsewhere

LLM token costs are hard to predict and control

15 posts from 15 people on GitHub issues, Hacker News, Reddit.

Anthropic token costs are hard to predict

6 posts from 6 people on Hacker News, GitHub issues, Reddit.

OpenAI token costs are hard to predict

5 posts from 4 people on GitHub issues, Hacker News, Reddit.

Claude token costs are hard to predict

5 posts from 5 people on Hacker News, App Store reviews, Reddit.

Gemini token costs are hard to predict

3 posts from 3 people on Reddit, GitHub issues.

Claude Code token costs are hard to predict

3 posts from 3 people on Reddit, Hacker News, GitHub issues.

LlamaIndex token costs are hard to predict

2 posts from 2 people on GitHub issues. Unverified.

GitHub Copilot token costs are hard to predict

2 posts from 2 people on Reddit. Unverified.

Other GitHub problems

GitHub vulnerabilities are hard to triage and patch

23 posts from 20 people on GitHub issues, Glyph Ibis, Hacker News.

Trouble with GitHub page

Top post: "allowedDevOrigins causes a hydration mismatch (display:contents metadata boundary) on every full page load", one of 9 posts from 8 people on GitHub issues.

GitHub upgrades break working setups

109 posts from 94 people on GitHub issues, Hacker News, Stack Overflow.

GitHub users keep filing bugs

Top post: "Workload-Aware Preemption may result in unnecessary or cascading preemptions", one of 92 posts from 89 people on GitHub issues, Reddit, App Store reviews.

Trouble with GitHub next

Top post: "Next Image component fails when a relative src redirects to an external image", one of 22 posts from 20 people on GitHub issues, Reddit.

GitHub outages and slowdowns disrupt work

17 posts from 17 people on Hacker News, GitHub issues, Reddit.

Trouble with GitHub check

Top post: "E2E testing: check for goroutine leaks", one of 16 posts from 8 people on GitHub issues.

GitHub lock-in makes switching costly

13 posts from 11 people on GitHub issues.

Trouble with GitHub test

Top post: "Remove TestContext from test/integration/util and use ktesting.TContext instead", one of 12 posts from 8 people on GitHub issues, Reddit.

GitHub dependency conflicts break installs

12 posts from 9 people on GitHub issues, Hacker News.

GitHub rate limits and usage caps block work

11 posts from 10 people on GitHub issues, Hacker News.

Migrating to or off GitHub is slow and risky

11 posts from 11 people on GitHub issues, Hacker News.

History

First seen with 2 posts.

Nov 18, 2026