Data and AI struggles

1,730 problems · 342 companies

DevOps and infra

Kubernetes users keep filing bugs

34 posts from 33 people30d activeFading, +2 this week

Posts per day

Posts per day34 posts, Aug 26 to Nov 9

The posts behind it

GitHub issuestailscale/tailscale · madispNov 5

FR: egress ProxyGroup fails at 1000+ ports

...This was indeed unexpected, I did not see any mention of this in the documentation. ### How should we solve this? Would it be possibly to either configure the number of available ports here or alternatively perform some sort of uniform hashing automatically? ### What is the...

1 replies
Redditr/devops · u/Ambitious-Future-800Nov 3

Which YouTube channels actually help with platform/infra work?

I wish to trim my subscriptions to ones worth thewatching time . Who do you watch for K8s, internal platforms, and lately LLM infra (gateways, routing, cost/observability)?. Deep-dives over hype preferred..

GitHub issueskubernetes/kubernetes · muskan-creates352Nov 1

[SIG-CLI] Migrate legacy klog.Errorf to structured logging in kubectl describe

...`klog.Errorf` instead of structured logging (`klog.ErrorS`): - Line 760: `klog.Errorf("Unable to construct reference to '%#v': %v", pod, err)` - Line 3467: `klog.Errorf("Unable to construct reference to '%#v': %v", node, err)` ### Proposed Change Migrate these calls to modern...

1 replies
GitHub issueskubernetes/kubernetes · muskan-creates352Oct 30

[SIG-Storage] Migrate legacy klog.Errorf to structured logging in pkg/volume/nfs

### Description In `pkg/volume/nfs/nfs.go`, several error logging calls still use legacy unstructured `klog.Errorf` instead of structured logging (`klog.ErrorS`): - Line 248: `klog.Errorf("IsNotMountPoint check failed: %v", mntErr)` - Line 253: `klog.Errorf("Failed to unmount:...

1 replies
GitHub issueskubernetes/kubernetes · Miracle575Oct 29

Support administrator-authorized per-Pod UID/GID mappings for shared-storage ownership and quotas

### What would you like to be added? An opt-in mechanism for administrators or trusted platform controllers to configure authorized per-Pod UID/GID mappings between container and host identities, with explicitly defined file ownership behavior on data volumes. We need to combine...

1 replies
GitHub issueskubernetes/kubernetes · pacoxuOct 29

kubeadm CI failures: [sig-node] Secrets should be consumable

...has failed 8 times since it last passed at commit/aabdf5a22. It started failing between commit/aabdf5a22 (Wed Oct 28 09:31 PDT) and commit/882d7194b (Wed Oct 28 11:31 PDT): . - Test [Kubernetes e2e suite.[It] [sig-node] Secrets should be consumable via the environment...

9 replies
GitHub issuesPrefectHQ/prefect · j-hametOct 28

Kubernetes worker API-key Secret creation fails during concurrent submissions

### Bug summary Concurrent Kubernetes worker submissions can fail before their Jobs are created when automatic API-key Secret creation is enabled. Submissions from the same worker use the same Secret name in a target namespace. If both reads return 404, one create succeeds and...

GitHub issuesvllm-project/vllm · raravind007Oct 26

[RFC]: Define a graceful-draining contract for external Kubernetes controllers

### Motivation Hi vLLM maintainers, I'm developing a reference inference-aware drain plugin for NVIDIA NVSentinel, which detects GPU faults and coordinates Kubernetes node remediation. References: - NVSentinel proposal: https://github.com/NVIDIA/NVSentinel/issues/2124 -...

1 reactions
GitHub issueskubernetes/kubernetes · yogeshbendreOct 24

DRA device taint eviction ignores DeviceToleration with empty effect, although the API says empty matches all effects

...taint key/value tolerates the NoExecute taint, same as one with `effect: NoExecute`. ### How can we reproduce it (as minimally and precisely as possible)? Cluster with DRA and the example driver (4 devices). Four claims, each used by one running pod, tolerations on the request:...

4 replies
GitHub issueskubernetes/kubernetes · matchsellerOct 23

DRA:currently lacks a scoring logic for devices

...added? Currently, DRA lacks a mechanism for scoring or ranking devices, which makes it impossible to implement device selection strategies such as "binpack" or "spread." After carefully reviewing the DRA feature code, I have developed a preliminary solution to address this: 1. I...

3 replies
GitHub issuesPrefectHQ/prefect · bnaulOct 22

KubernetesJob.wait_for_completion raises "failed due to []" on K8s 1.31+ SuccessCriteriaMet condition

### Bug summary Since Kubernetes 1.31 (the `JobSuccessPolicy` / Job condition changes), a successful Job gets an interim `SuccessCriteriaMet=True` condition before `Complete=True`. If `await_for_completion` polls in that window, `final_completed_conditions` is non-empty but has...

GitHub issueskubernetes/kubernetes · kyyrilOct 22

pkg/controller: reduce allocations in FilterPodsByOwner

### What would you like to be added? `controller.FilterPodsByOwner` collects the Pods returned by the owned and orphaned indexer lookups into a result slice that starts empty and is grown by repeated appends. For an owner with thousands of Pods, most of the allocated bytes in...

3 replies
GitHub issueskubernetes/kubernetes · BroYongVeryBusyOct 19

What is the rationale for setting ReconcilerMaxWaitForUnmountDuration to 6 minutes?

Hi Kubernetes maintainers, While reading the attach/detach controller code, I noticed that `ReconcilerMaxWaitForUnmountDuration` is set to a fixed value of six minutes: ```go // ReconcilerMaxWaitForUnmountDuration is the maximum amount of time the // attach detach controller...

2 replies
Stack OverflowStack Overflow [kubernetes] · AmericanOct 13

What breaks in Kubernetes if I restore etcd from a snapshot without `--bump-revision`?

etcdutl snapshot restore documents --bump-revision ("how much to increase the latest revision after restore") and --mark-compacted . Kubernetes disaster-recovery guides recommend considering them.. I understand the general idea: the restored member's revision must be higher than...

GitHub issueskubernetes/kubernetes · tosi3kOct 12

kube-scheduler: (Composite)PodGroup update event handlers don't distinguish a real update from a coalesced delete+create

...keep assuming it is looking at the same object with only mutable fields changed. ### How can we reproduce it (as minimally and precisely as possible)? Call `sched.updatePodGroup(oldPG, newPG)` where `newPG` has a different UID, a later `creationTimestamp` and a different...

4 replies
GitHub issueskubernetes/kubernetes · felpau05Oct 8

kubectl config set panics on users.<name>.exec and users.<name>.auth-provider

...code 2. /sig cli ### What did you expect to happen? An error instead of a panic. ### How can we reproduce it (as minimally and precisely as possible)? ### Anything else we need to know? `modifyConfig` in `staging/src/k8s.io/kubectl/pkg/cmd/config/set.go` has no case for pointer...

2 replies
GitHub issueskubernetes/kubernetes · brantburnettOct 7

Support the HTTP QUERY method (RFC 10008) in API server proxy subresources

...authorization (verb mapping), or audit logging need changes for a new method? ### Workarounds today `kubectl port-forward`, or fronting the service with a gateway or ingress that passes arbitrary methods.

7 replies
GitHub issueskubernetes/kubernetes · wojtek-tOct 6

PreFilter Skip can be invalidated by a reprieved victim

...constraint. ### What did you expect to happen? Pod Anti-Affinity to be honored. ### How can we reproduce it (as minimally and precisely as possible)? Try scheduling a pod (without any constraints) that is matched against anti-affinity rules from all currently running pods...

3 replies
GitHub issueskubernetes/kubernetes · omerap12Oct 6

HPA scales down above target when pods are unready

Raising an issue that has been discussed for a while without a real solution. Currently, for Object and External metrics with a `Value` target, the HPA computes: Pods could fail their readiness probes (due to overload or connection issue for example). As they do, `readyPodCount`...

3 replies
GitHub issueskubernetes/kubernetes · rithwik-01Oct 5

kube-apiserver: DELETE with a resourceVersion precondition permanently fails with 409 when the delete removes the object's last GC finalizer

...which is not something a client can detect, retry past, or recover from. ### How can we reproduce it (as minimally and precisely as possible)? No manual patching of finalizers is needed - the state arises from ordinary foreground deletion of an object with a stuck dependent....

2 replies
GitHub issueskubernetes/kubernetes · HosniBelfekiOct 3

apimachinery yaml: YAMLOrJSONDecoder drops a trailing document shorter than 4 bytes

### What happened? `YAMLOrJSONDecoder` fails to decode a document when fewer than 4 bytes remain in the stream. The same document decodes correctly if a single trailing space is added. The cutoff is exactly 4 bytes, which is the read size in `consumeWhitespace`....

1 replies
Stack OverflowStack Overflow [kubernetes] · geppettodivacinSep 29

How do I manage Mongock / Flamingock data migrations with a rolling Kubernetes deployment?

We use kubernetes to deploy our services, and our services typically have three or more replicas. This has caused a problem when we want our Spring Boot-initialized Mongock (and soon, Flamingock) to perform any data migration: when performing a normal roll-out, the change unit...

1 replies
GitHub issuesopen-webui/open-webui · djlongySep 23

issue: .md uploaded as application/octet-stream is sent to the extraction engine (Docling/Tika) instead of TextLoader

### Before Submitting - [x] I searched open and closed issues and discussions for an existing report. - [ ] I reproduced this bug on the latest release AND on the current `dev` branch. Reproduced on v0.11.4. On `dev` (24c01bd) I checked the code path, which is unchanged, but did...

2 replies
GitHub issueskubernetes/kubernetes · reckless-sherixxSep 18

ParseToLabelSelector rejects "!=", so kubectl create pdb and kubectl set selector fail on selectors that work with kubectl get -l

### What happened? `metav1.ParseToLabelSelector` rejects the `!=` operator, so the kubectl commands that build a `LabelSelector` from a user-supplied selector string fail on a selector that works everywhere else: `labels.Parse` accepts `key!=value`, but `ParseToLabelSelector`,...

1 replies
GitHub issueskubernetes/kubernetes · jsorefSep 17

`Pod didn't trigger scale-up` should specify needs

...selector` isn't matched and there is only one (or maybe two), list it ### How can we reproduce it (as minimally and precisely as possible)? define a pod create some nodes that don't perfectly match the requirements. run: trying to figure out why the pod won't work. - Knowing...

5 replies
GitHub issueskubernetes/kubernetes · piyushtekSep 14

On clicking User Case Studies 404 poping up

### What happened? https://kubernetes.io/case-studies/ gives 404 ### What did you expect to happen? Should open user case studies page ### How can we reproduce it (as minimally and precisely as possible)? Click Should open user case studies page

4 replies
GitHub issueskubernetes/kubernetes · dimsSep 13

unit-master-golang-tip red: two upstream net/http bugs, not kubernetes bugs

...tests need to stop asserting `Close() == nil`. /sig api-machinery /sig testing /kind failing-test

1 reactions1 replies
GitHub issueskubernetes/kubernetes · feeopsSep 9

build error

### What happened? version ### What did you expect to happen? go build without error ### How can we reproduce it (as minimally and precisely as possible)? code use latest lib ### Anything else we need to know? _No response_ ### Kubernetes version ### Cloud provider ### OS...

3 replies
GitHub issuesgrafana/grafana · ariel-rivoSep 9

provisioning: BVitbucket pull requests cant be opened through ui

...### What did you expect to happen? it should work ### Did this work before? yes ### How do we reproduce it? 1. provision bitbucket repo 2. make changes to dashboard 3. commit and click on the `open pr` popup ### Is the bug inside a dashboard panel? no ### Environment (with...

1 replies
GitHub issueskubernetes/kubernetes · BytamineSep 3

in-tree iSCSI: DetachBlockISCSIDisk fails permanently when the by-path link is already gone, stranding the volume in volumesInUse

...teardown is meant to clean up, and the code that gets skipped already handles it. ### How can we reproduce it (as minimally and precisely as possible)? 1. Run a pod with a block-mode (`volumeMode: Block`) in-tree iSCSI PV on node A. 2. With kubelet still running, log the session...

6 replies
Redditr/devops · u/iykay_Aug 29

DevOps and K8s experience.

...example app from a random github repo to use in learning process.. Which is better or any advice on what to learn?. And any tools and apps to deploy on the k8s cluster or homelab to aid in the learning process..

GitHub issuesPrefectHQ/prefect · chuqCTCAug 27

Kubernetes observer repeats state checks and logs for unchanged Pending pods

### Bug summary Repeated `Pending` pod events cause the Kubernetes observer to repeat work for the same condition: - Every event calls `read_flow_run` and may call `propose_state(InfrastructurePending(...))` again. - Diagnosis deduplication compares the full rendered message....

Redditr/devops · u/Medium-Direction-191Aug 26

How would you recommend learning Kubernetes and Helm effectively?

...how Kubernetes works and become comfortable using it in a real work environment.. Any advice on how you would approach learning it from scratch would be greatly appreciated. Thanks!.

Companies and products named

34 posts
3 posts
2 posts
2 posts
1 post
1 post
About this problem

Evidence

34 posts from 33 people in 9 places, about 3 a week over 72 days. Mostly on kubernetes/kubernetes, r/devops, PrefectHQ/prefect. Tools named alongside: Prefect, GitHub, Docker, Claude.

Frustration Frustration 1 of 3· Seen on GitHub issues, Reddit, Stack Overflow, Community forums

How it was grouped

Posts about Kubernetes that state a pain but match no known issue yet. First post Aug 26, 2026, latest Nov 5, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

Other Kubernetes problems

Kubernetes upgrades break working setups

23 posts from 19 people on GitHub issues, Hacker News, Stack Overflow.

Kubernetes lock-in makes switching costly

13 posts from 10 people on GitHub issues.

Trouble with Kubernetes test

Top post: "HugepageAwareMemoryReporting [Feature:HugePages] with feature gate enabled should subtract hugepage capacity", one of 10 posts from 9 people on GitHub issues.

Kubernetes permissions are confusing and error-prone

9 posts from 5 people on Mastodon, Bluesky, Reddit.

Kubernetes is too complex to run well

8 posts from 8 people on GitHub issues, Stack Overflow.

Trouble with Kubernetes list

Top post: "MutatingAdmissionPolicy: a JSON patch value holding an Object initializer inside a list panics the apiserver", one of 4 posts from 4 people on GitHub issues, Stack Overflow.

Trouble with Kubernetes kubelet

Top post: "Node Declared Features: allow a feature to opt out of re-admission enforcement after kubelet restart", one of 4 posts from 4 people on GitHub issues.

Kubernetes rate limits and usage caps block work

4 posts from 4 people on GitHub issues, Reddit.

Kubernetes outages and slowdowns disrupt work

3 posts from 3 people on GitHub issues.

Trouble with Kubernetes preemption

Top post: "Delete preempted gang PodGroups and CompositePodGroups (DisruptionMode: All) during scheduler preemption", one of 3 posts from 3 people on GitHub issues.

Kubernetes deprecations force unplanned migrations

3 posts from 3 people on GitHub issues.

Kubernetes vulnerabilities are hard to triage and patch

3 posts from 1 person on GitHub issues. Unverified.

History

Momentum went from steady to fading.

Nov 8, 2026

Momentum went from fading to steady.

Nov 7, 2026

Momentum went from steady to fading.

Nov 5, 2026

Momentum went from fading to steady.

Nov 4, 2026

Momentum went from steady to fading.

Oct 30, 2026

Momentum went from rising to steady.

Oct 29, 2026

Momentum went from steady to rising.

Oct 27, 2026

Momentum went from rising to steady.

Oct 26, 2026

Momentum went from fading to rising.

Oct 25, 2026

Momentum went from steady to fading.

Oct 20, 2026

Momentum went from fading to steady.

Oct 17, 2026

Momentum went from steady to fading.

Oct 13, 2026