Hey guys, I install microk8s with snap on my Debian 10 VM at a cloud provider but somehow it is not starting up. Any ideas about this?
kubectl describe no
Name: my-domain.com
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=my-domain.com
kubernetes.io/os=linux
microk8s.io/cluster=true
node.kubernetes.io/microk8s-controlplane=microk8s-controlplane
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 04 Feb 2023 14:40:28 +0100
Taints: node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: my-domain.com
AcquireTime: <unset>
RenewTime: Sat, 04 Feb 2023 14:41:59 +0100
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 04 Feb 2023 14:40:58 +0100 Sat, 04 Feb 2023 14:40:27 +0100 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 04 Feb 2023 14:40:58 +0100 Sat, 04 Feb 2023 14:40:27 +0100 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 04 Feb 2023 14:40:58 +0100 Sat, 04 Feb 2023 14:40:27 +0100 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Sat, 04 Feb 2023 14:40:58 +0100 Sat, 04 Feb 2023 14:40:27 +0100 KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
Addresses:
InternalIP: 7.192.174.253
Hostname: my-domain.com
Capacity:
cpu: 8
ephemeral-storage: 825255852Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 30877236Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 824207276Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 30774836Ki
pods: 110
System Info:
Machine ID: b325d9731b2e4def8cfd35ea84b7674c
System UUID: b325d973-1b2e-4def-8cfd-35ea84b7674c
Boot ID: b0bb6e23-cd77-40bb-8dfc-814b5c93e425
Kernel Version: 4.19.0-22-amd64
OS Image: Debian GNU/Linux 10 (buster)
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.6.8
Kubelet Version: v1.26.0
Kube-Proxy Version: v1.26.0
Non-terminated Pods: (1 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system calico-node-ngjm8 250m (3%) 0 (0%) 0 (0%) 0 (0%) 89s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 250m (3%) 0 (0%)
memory 0 (0%) 0 (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 95s kube-proxy
Normal Starting 98s kubelet Starting kubelet.
Warning InvalidDiskCapacity 98s kubelet invalid capacity 0 on image filesystem
Normal NodeHasSufficientMemory 98s (x2 over 98s) kubelet Node my-domain.com status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 98s (x2 over 98s) kubelet Node my-domain.com status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 98s (x2 over 98s) kubelet Node my-domain.com status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 98s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 93s node-controller Node my-domain.com event: Registered Node my-domain.com in Controller
kubectl describe no
Name: my-domain.com
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=my-domain.com
kubernetes.io/os=linux
microk8s.io/cluster=true
node.kubernetes.io/microk8s-controlplane=microk8s-controlplane
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 04 Feb 2023 14:40:28 +0100
Taints: node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: my-domain.com
AcquireTime: <unset>
RenewTime: Sat, 04 Feb 2023 14:41:59 +0100
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 04 Feb 2023 14:40:58 +0100 Sat, 04 Feb 2023 14:40:27 +0100 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 04 Feb 2023 14:40:58 +0100 Sat, 04 Feb 2023 14:40:27 +0100 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 04 Feb 2023 14:40:58 +0100 Sat, 04 Feb 2023 14:40:27 +0100 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Sat, 04 Feb 2023 14:40:58 +0100 Sat, 04 Feb 2023 14:40:27 +0100 KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
Addresses:
InternalIP: 7.192.174.253
Hostname: my-domain.com
Capacity:
cpu: 8
ephemeral-storage: 825255852Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 30877236Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 824207276Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 30774836Ki
pods: 110
System Info:
Machine ID: b325d9731b2e4def8cfd35ea84b7674c
System UUID: b325d973-1b2e-4def-8cfd-35ea84b7674c
Boot ID: b0bb6e23-cd77-40bb-8dfc-814b5c93e425
Kernel Version: 4.19.0-22-amd64
OS Image: Debian GNU/Linux 10 (buster)
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.6.8
Kubelet Version: v1.26.0
Kube-Proxy Version: v1.26.0
Non-terminated Pods: (1 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system calico-node-ngjm8 250m (3%) 0 (0%) 0 (0%) 0 (0%) 89s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 250m (3%) 0 (0%)
memory 0 (0%) 0 (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 95s kube-proxy
Normal Starting 98s kubelet Starting kubelet.
Warning InvalidDiskCapacity 98s kubelet invalid capacity 0 on image filesystem
Normal NodeHasSufficientMemory 98s (x2 over 98s) kubelet Node my-domain.com status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 98s (x2 over 98s) kubelet Node my-domain.com status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 98s (x2 over 98s) kubelet Node my-domain.com status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 98s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 93s node-controller Node my-domain.com event: Registered Node my-domain.com in Controller
kubectl get no
NAME STATUS ROLES AGE VERSION
my-domain.com NotReady <none> 8m59s v1.26.0
journalctl -fu snap.microk8s.daemon-kubelite
-- Logs begin at Sat 2023-02-04 10:58:09 CET. --
Feb 04 14:52:17 my-domain.com microk8s.daemon-kubelite[12979]: W0204 14:52:17.229145 12979 manager.go:1174] Failed to process watch event {EventType:0 Name:/kubepods/burstable/pod4be9f2d7-3505-46c2-871e-8580168de486/be33476a60241c3bfde8f777bcd59df4cebe4d2deb281b743a842c3dfed82a6e WatchSource:0}: container "be33476a60241c3bfde8f777bcd59df4cebe4d2deb281b743a842c3dfed82a6e" in namespace "k8s.io": not found
Feb 04 14:52:18 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:18.180448 12979 kubelet.go:2475] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
Feb 04 14:52:23 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:23.182056 12979 kubelet.go:2475] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
Feb 04 14:52:25 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:25.168444 12979 remote_runtime.go:176] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: can't copy bootstrap data to pipe: write init-p: broken pipe: unknown"
Feb 04 14:52:25 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:25.168575 12979 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: can't copy bootstrap data to pipe: write init-p: broken pipe: unknown" pod="kube-system/calico-node-ngjm8"
Feb 04 14:52:25 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:25.168634 12979 kuberuntime_manager.go:782] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: can't copy bootstrap data to pipe: write init-p: broken pipe: unknown" pod="kube-system/calico-node-ngjm8"
Feb 04 14:52:25 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:25.168776 12979 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-node-ngjm8_kube-system(4be9f2d7-3505-46c2-871e-8580168de486)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-node-ngjm8_kube-system(4be9f2d7-3505-46c2-871e-8580168de486)\\\": rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: can't copy bootstrap data to pipe: write init-p: broken pipe: unknown\"" pod="kube-system/calico-node-ngjm8" podUID=4be9f2d7-3505-46c2-871e-8580168de486
Feb 04 14:52:28 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:28.183050 12979 kubelet.go:2475] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
Feb 04 14:52:28 my-domain.com microk8s.daemon-kubelite[12979]: W0204 14:52:28.224923 12979 manager.go:1174] Failed to process watch event {EventType:0 Name:/kubepods/burstable/pod4be9f2d7-3505-46c2-871e-8580168de486/4434e186bf9acbde24f4705ed3bf28b83eeb4a9a069f16326d3692d379ed8d5f WatchSource:0}: container "4434e186bf9acbde24f4705ed3bf28b83eeb4a9a069f16326d3692d379ed8d5f" in namespace "k8s.io": not found
Feb 04 14:52:33 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:33.184171 12979 kubelet.go:2475] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
Feb 04 14:52:38 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:38.185820 12979 kubelet.go:2475] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
Feb 04 14:52:39 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:39.168935 12979 remote_runtime.go:176] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: can't copy bootstrap data to pipe: write init-p: broken pipe: unknown"
Feb 04 14:52:39 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:39.169038 12979 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: can't copy bootstrap data to pipe: write init-p: broken pipe: unknown" pod="kube-system/calico-node-ngjm8"
Feb 04 14:52:39 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:39.169084 12979 kuberuntime_manager.go:782] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: can't copy bootstrap data to pipe: write init-p: broken pipe: unknown" pod="kube-system/calico-node-ngjm8"
Feb 04 14:52:39 my-domain.com microk8s.daemon-kubelite[12979]: E0204 14:52:39.169200 12979 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-node-ngjm8_kube-system(4be9f2d7-3505-46c2-871e-8580168de486)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-node-ngjm8_kube-system(4be9f2d7-3505-46c2-871e-8580168de486)\\\": rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: can't copy bootstrap data to pipe: write init-p: broken pipe: unknown\"" pod="kube-system/calico-node-ngjm8" podUID=4be9f2d7-3505-46c2-871e-8580168de486