Problemsby GlyphGPU access, drivers and CUDA versions are painful
7 posts from 7 people7d activeSteady, +1 this week
Posts per day
The posts behind it
[BUG] Gemma 4 assistant models fail to build since KV sharing was formalized
### System Info * `transformers` version: `5.23.0.dev0` * Platform: `Linux-6.8.0-1070-gcp-x86_64-with-glibc2.35` * Python version: `3.12.13` * `huggingface_hub` version: `2.4.0` * `safetensors` version: `0.8.0` * `accelerate` version: `1.15.0` * PyTorch version (accelerator?):...
[BUG] Async native tools run on a per-call event loop, so caller-loop-bound resources fail under kickoff_async
### Description Async native tools lose the kickoff caller's event loop. When a crew is started with `kickoff_async()` (or `AgentExecutor.invoke_async()`), the sync lane runs in worker threads, and the native tool call path awaits the tool's coroutine via a bare `asyncio.run()`...
[OOM] llama-server (2xV100 tensor-parallel, GGML_CUDA_NCCL) accumulates ~93GB shmem-rss; kernel OOM-kill under numactl membind
## Summary `llama-server` (custom ppc64le V100 build, `GGML_CUDA_NCCL=ON`) serving a large-context MoE model with 2-GPU tensor-split on cross-socket GPUs accumulates **~93 GB of shared-memory RSS (shmem-rss)**. When the service is NUMA-pinned via `numactl --membind`, the kernel...
[Bug]: AlephAlphaEmbedding ignores hosting, timeout, max_retries and verify_ssl constructor arguments
### Bug Description `AlephAlphaEmbedding.__init__` accepts `hosting`, `timeout`, `max_retries` and `verify_ssl`, but never passes them to `super().__init__`, so the corresponding pydantic fields keep their defaults (`None`, `None`, `10`, `True`). `_get_credential_kwargs` then...
feat(channels): outgoing webhooks and event subscriptions for bi-directional integrations
### Summary Open WebUI **Channels** currently support incoming webhooks (`POST /api/v1/channels/{id}/messages`), allowing external systems to push messages into a channel. However, there is no corresponding **Outgoing Webhooks** or **Event Subscription** mechanism. As a result,...
[Bug]: DeepSeek-V4.1-Flash worker dies with `CUDA error: unspecified launch failure` during long-context decode with dspark spec decode (DP=3, TP=2, EP); Anthropic `/v1/messages` adapter then fails on the error chunk
### Your current environment ## Your current environment Environment ### Launch command (non-default args as logged by vLLM) Equivalent CLI: ## Model Input Dumps Scheduler output dumped by `dump_input.py` at crash time. Both crashes happened in a pure decode step (no new...
Dailychained PLX 88096 switches, Quad RTX 5070 Ti + Quad RTX 5060 Ti
...Australia, most everything else is from China 2-4 weeks shipping, if a cable or adapter doesn't work then more delays and i pay sales tax 15% at the border. Also these cases party trick is they can be bolted vertically so assuming I can manage rising heat that option saves a bit...
Companies and products named
About this problem
Evidence
7 posts from 7 people in 7 places, about 1 a week over 41 days. Mostly on r/LocalLLaMA, vllm-project/vllm, open-webui/open-webui. Tools named alongside: NVIDIA, OpenAI, vLLM, Hugging Face.
Frustration Frustration 2 of 3· Seen on GitHub issues, Reddit
How it was grouped
Posts that state a pain and match the "gpu-access" rule. First post Sep 24, 2026, latest Nov 3, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
PyTorch GPU access and drivers are painful
14 posts from 14 people on GitHub issues.
NVIDIA GPU access and drivers are painful
12 posts from 12 people on GitHub issues, Mastodon, Reddit.
DeepSeek GPU access and drivers are painful
7 posts from 6 people on GitHub issues.
vLLM GPU access and drivers are painful
5 posts from 3 people on GitHub issues.
Claude Code GPU access and drivers are painful
3 posts from 3 people on GitHub issues.
Ollama GPU access and drivers are painful
3 posts from 3 people on Hacker News, Reddit, GitHub issues.
Chroma GPU access and drivers are painful
2 posts from 1 person on GitHub issues. Unverified.
Mistral GPU access and drivers are painful
2 posts from 2 people on GitHub issues. Unverified.
History