GitHub token costs are hard to predict
2 posts from 2 people2d activeSteady, +1 this weekunverified
Posts per day
The posts behind it
[Bug] Token-priced rerank calls calculate zero cost despite reported input tokens
### Description Token-priced rerank responses calculate a cost of zero even when the response reports input tokens and the resolved model has a nonzero `input_cost_per_token`. A per-query control using the same public calculator returns the configured cost. The current catalog...
[P] Open-Sourcing a sub-15ms Deterministic Decision Gateway to eliminate 2-second LLM routing latencies (FastAPI/Python)
...decisions (e.g., safety guardrails or API triage). Token generation is inherently too slow and expensive for operational routing.. To solve this at scale, I built and open-sourced the "Dual-Process Jev Gateway.". It places a sub-15ms deterministic decision layer (System 1) in...
Companies and products named
About this problem
Evidence
2 posts from 2 people in 2 places, about 1 a week over 39 days. Mostly on r/mlops, BerriAI/litellm. Tools named alongside: BerriAI.
Frustration Frustration 0 of 3· Seen on Reddit, GitHub issues
How it was grouped
Posts that state a pain and match the "llm-cost" rule about GitHub. First post Oct 8, 2026, latest Nov 15, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
LLM token costs are hard to predict and control
15 posts from 15 people on GitHub issues, Hacker News, Reddit.
Anthropic token costs are hard to predict
6 posts from 6 people on Hacker News, GitHub issues, Reddit.
OpenAI token costs are hard to predict
5 posts from 4 people on GitHub issues, Hacker News, Reddit.
Claude token costs are hard to predict
5 posts from 5 people on Hacker News, App Store reviews, Reddit.
Gemini token costs are hard to predict
3 posts from 3 people on Reddit, GitHub issues.
Claude Code token costs are hard to predict
3 posts from 3 people on Reddit, Hacker News, GitHub issues.
LlamaIndex token costs are hard to predict
2 posts from 2 people on GitHub issues. Unverified.
GitHub Copilot token costs are hard to predict
2 posts from 2 people on Reddit. Unverified.
Other GitHub problems
GitHub vulnerabilities are hard to triage and patch
23 posts from 20 people on GitHub issues, Glyph Ibis, Hacker News.
Trouble with GitHub page
Top post: "allowedDevOrigins causes a hydration mismatch (display:contents metadata boundary) on every full page load", one of 9 posts from 8 people on GitHub issues.
GitHub upgrades break working setups
109 posts from 94 people on GitHub issues, Hacker News, Stack Overflow.
GitHub users keep filing bugs
Top post: "Workload-Aware Preemption may result in unnecessary or cascading preemptions", one of 92 posts from 89 people on GitHub issues, Reddit, App Store reviews.
Trouble with GitHub next
Top post: "Next Image component fails when a relative src redirects to an external image", one of 22 posts from 20 people on GitHub issues, Reddit.
GitHub outages and slowdowns disrupt work
17 posts from 17 people on Hacker News, GitHub issues, Reddit.
Trouble with GitHub check
Top post: "E2E testing: check for goroutine leaks", one of 16 posts from 8 people on GitHub issues.
GitHub lock-in makes switching costly
13 posts from 11 people on GitHub issues.
Trouble with GitHub test
Top post: "Remove TestContext from test/integration/util and use ktesting.TContext instead", one of 12 posts from 8 people on GitHub issues, Reddit.
GitHub dependency conflicts break installs
12 posts from 9 people on GitHub issues, Hacker News.
GitHub rate limits and usage caps block work
11 posts from 10 people on GitHub issues, Hacker News.
Migrating to or off GitHub is slow and risky
11 posts from 11 people on GitHub issues, Hacker News.
History