Skip to content
Problems.

Redis rate limits and usage caps block work

LLM apps3 posts from 3 people2d active+33 posts in the last 7 days, 0 the 7 days before (new)

Posts per day

Posts per day3 posts, Sep 23 to Sep 28

The posts behind it

3, newest first
PostDate
[Bug]: Scheduler never removes admitted requests from the priority queue, so prioritized requests fail during cooldown and, with Redis, under normal traffic### Description When a request goes through the priority scheduler and the model group has a healthy deployment, `Scheduler.poll()` returns `True` without touching the queue, and the router only calls `remove_request` on the timeout branch. Every request admitted this way leaves...BerriAI/litellmRachelHuangZWSep 244 days ago
[Bug]: sse_keepalive_ping_interval_seconds leaks a max_parallel_requests slot on every streaming request (ContextVar lost across asyncio.ensure_future)...on their face - a TTFT keepalive and a concurrency limiter - which is what makes this hard to spot. Turning the keepalive on silently disables slot release for the v3 rate limiter. Observed in production: enabled at 06:08 UTC, first key lockout at 06:17. One key made exactly...BerriAI/litellmjusticelSep 244 days ago
[Bug]: Completed batch can be skipped by model budget after logging cancellation### Description A completed batch can escape its model budget charge if success logging is cancelled after `_claim_batch_charge` increments the marker and before `_increment_spend_for_key` updates spend. Later polls see the marker and skip the charge even though the spend...BerriAI/litellmemerzonSep 235 days ago

Companies and products named

Company or productPosts naming it
Redis3
GitHub2
PyPI1
BerriAI1
Docker1
About this problem

Evidence

3 posts from 3 people in 1 place, about 3 a week over 2 days. Mostly on BerriAI/litellm. Tools named alongside: GitHub, PyPI, BerriAI, Docker.

Frustration Frustration 0 of 3· Seen on GitHub issues

How it was grouped

Posts that state a pain and match the "rate-limits" rule about Redis. First post Sep 23, 2026, latest Sep 24, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

Other Redis problems

History

  • 2026-09-28 Added: Redis rate limits and usage caps block work (3 posts)

Rising problems by email

Mondays: the problems in data, tech and AI that grew fastest that week.

Double opt-in. Unsubscribe any time.