TAG DIRECTORY
#Kubernetes

Everything about Kubernetes

Browse incidents, troubleshooting guides, AI diagnostics, verified fixes and community discussions related to Kubernetes.

12 troubles
AI VERIFIED
3h ago

Kubernetes pods CrashLoopBackOff only on upgraded nodes with hugepages enabled — short lived OOM at container startup

## Environment GKE-like cluster: two node pools — old pool (Ubuntu 18.04, no hugepages) where workload stable, upgraded node pool (Ubuntu 20.04, kernel 5.4) configured with hugepages-1G reserved (systemd hugepages mount) via kubelet and cloud-init; ...

AI VERIFIED
1d ago

Kubernetes pods OOMKilled while node shows 80GB free memory on Ubuntu 20.04 (kubelet+Docker cgroup mismatch suspected)

## Environment On-prem Kubernetes 1.23 control plane, 5 worker nodes (Ubuntu 20.04, Docker 20.10.12, kubelet configured with cgroupDriver=systemd). Workers: 128GB RAM, 32 vCPU. Applications deployed as Deployments with requests/limits set (example: ...

AI VERIFIED
2d ago

Kubernetes PVCs stuck Pending after node migration — CSI node plugin fails to register with kubelet

## Environment On-prem K8s 1.25 cluster running kubelet systemd service on Ubuntu 22.04 nodes. CSI driver for vendor SAN is deployed as a DaemonSet (node plugin) and StatefulSet (controller). Problem observed after rolling nodes to a new image with ...

AI VERIFIED
2d ago

CoreDNS resolution breaks inside pods after kube-proxy switch to IPVS on Debian worker nodes

## Environment On-premises k8s: control plane on Ubuntu 20.04, worker nodes running Debian 11, kube-proxy switched from iptables to IPVS mode via kubeadm; CoreDNS v1.8.0 in kube-system; Calico CNI in use (policy only), nodes use systemd-resolved loc...

AI VERIFIED
1w ago

Kubernetes pods repeatedly OOM-killed even though node has ample free memory — cgroup vs kubelet limit mismatch

## Environment EKS-like on-prem Kubernetes cluster v1.24 running kubelet 1.24, containerd runtime, nodes are 64GB RAM Linux VMs (Ubuntu 22.04) with kube-reserved 1Gi and system-reserved 1Gi configured. A microservice (Go binary) requests 512Mi and s...

AI VERIFIED
1w ago

Kubernetes admission webhook causes API server 404s for gRPC services only when behind AWS NLB with proxy-protocol enabled

## Environment EKS cluster: Kubernetes 1.23 control plane, AWS NLB in front of nginx-ingress-controller Service (type=LoadBalancer) with proxy-protocol v2 enabled; several apps expose gRPC services via HTTP/2 through the ingress. ## Symptoms Exter...

AI VERIFIED
1w ago

Kubernetes: ConfigMap updates not reflected in pods using projected volume unless pod restarted (changes appear after 2–3 minutes only sometimes)

## Environment On-prem K8s cluster v1.25 with kubelet on Ubuntu 22.04 nodes, pods mount ConfigMap via projected volume (volumeMount to /app/config). Pod runs a Java application under OpenJDK 17 that reads configuration files on startup. ConfigMap up...

AI VERIFIED
1w ago

Kubernetes nodes fail to pull container images after containerd overlay storage filled on GKE-like cluster

## Environment On-prem K8s cluster (v1.26) with containerd 1.7, nodes provisioned from a node pool with 200 GB root disk; workloads include several large images (~2–6 GB each) and a nightly batch job that pulls and extracts images concurrently. ## ...

AI VERIFIED
1w ago

Kubernetes StatefulSet pods fail to mount Ceph PVCs on nodes upgraded to newer kubelet: 'failed to find device' in kubelet logs

## Environment On-prem kubeadm cluster: control plane on v1.26, worker nodes were recently upgraded from kubelet v1.25 to v1.27. Storage: Ceph RBD provisioned via CSI driver v3.x; nodes use kernel rbd module and rbd-nbd helpers. StatefulSet with Rea...

AI VERIFIED
1w ago

GKE cluster DNS fails inside pods intermittently after node auto-scaler removes older node pool

## Environment Google Kubernetes Engine (GKE) Autopilot cluster v1.25.7-gke.1200 with two node pools: pool-a (n1-standard-4) and pool-b (n2-standard-2). Cluster uses CoreDNS (coredns/coredns:1.8.4) as DNS add-on, Cloud NAT for outbound internet, Cal...

Page 1 of 2