Problemsby IbisRunning GitHub locally hits memory and speed limits
MLOps2 posts from 2 people2d active+11 post in the last 7 days, 0 the 7 days before (steady)Unverified
Posts per day
The posts behind it
2, newest firstVulkan (AMD, Windows, no ReBAR): DEVICE_LOCAL|HOST_VISIBLE buffers are backed by system memory and exhaust the WDDM shared budget -> vkQueueSubmit returns ErrorOutOfDeviceMemory## Summary `ggml_vk_create_buffer_device()` requests the `DEVICE_LOCAL|HOST_VISIBLE|HOST_COHERENT` memory type first for every device buffer and only falls back to plain `DEVICE_LOCAL` if that allocation fails. On a GPU without resizable BAR, that type lives in a 256 MiB heap....ggml-org/llama.cpp · laurentvv1 repliesOpen ↗Experimenting with hypersurface-constrained dynamic weight updating [P]...test an approach to reduce the number of the model's training parameters, since the main bottleneck in training is VRAM.. The core idea is very similar to Universal Transformer. Let's take just a single decoder block and iteratively pass the input through it L times in a loop....r/MachineLearning · u/manila_danimalsOpen ↗
Companies and products named
About this problem
Evidence
2 posts from 2 people in 2 places, about 1 a week over 32 days. Mostly on r/MachineLearning, ggml-org/llama.cpp. Tools named alongside: llama.cpp.
Frustration Frustration 0 of 3· Seen on Reddit, GitHub issues
How it was grouped
Posts that state a pain and match the "local-llm" rule about GitHub. First post Sep 19, 2026, latest Oct 20, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
Running llama.cpp locally hits memory and speed limitsRunning Ollama locally hits memory and speed limitsRunning LLMs locally hits memory and speed limitsRunning Qwen locally hits memory and speed limitsRunning NVIDIA locally hits memory and speed limitsRunning Hugging Face locally hits memory and speed limitsRunning vLLM locally hits memory and speed limitsRunning OpenAI locally hits memory and speed limitsRunning Claude Code locally hits memory and speed limitsRunning PyTorch locally hits memory and speed limitsRunning Mistral locally hits memory and speed limitsRunning DeepSeek locally hits memory and speed limits
Other GitHub problems
Trouble with GitHub terminalTrouble with GitHub nextGitHub dependency conflicts break installsTrouble with GitHub checkGitHub outages and slowdowns disrupt workMigrating to or off GitHub is slow and riskyGitHub rate limits and usage caps block workRAG on GitHub returns irrelevant or missing contextTrouble with GitHub testGitHub lock-in makes switching costlyTrouble with GitHub proxyGitHub vulnerabilities are hard to triage and patch
History
Running GitHub locally hits memory and speed limits (2 posts)