Cluster information:
Kubernetes version: 1.13.7-gke.15
Cloud being used: GKE
Installation method: Manual (via GKE UI)
Host OS: Container-Optimized OS
I just had one of the nodes in the GKE cluster restart automatically. I SSH’d into the node to look at any logs but was unable to find any reason as to why it restarted. Is there anyway I can find more information around the restart ? last command obviously didnt help.
Looking at the nodepool one thing I did notice was,
management:
autoRepair: true
I am also noticing a flurry of activity when it comes to the operations. It just continuously executes these operations every minute or so,
operation-1565142075236-2216b77e UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:41:15.236179922Z 2019-08-07T01:41:15.487596527Z
operation-1565142135134-c4181fbe UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:42:15.13447661Z 2019-08-07T01:42:15.398610433Z
operation-1565142194503-f8ad114a UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:43:14.503064607Z 2019-08-07T01:43:14.724076009Z
operation-1565142255350-5d8c78a6 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:44:15.350208562Z 2019-08-07T01:44:15.589586295Z
operation-1565142314976-479b25cf UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:45:14.976365136Z 2019-08-07T01:45:15.205579766Z
operation-1565142375065-db9376b1 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:46:15.065119936Z 2019-08-07T01:46:15.302332457Z
operation-1565142434499-4561216a UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:47:14.499013085Z 2019-08-07T01:47:14.727517095Z
operation-1565142495066-be62d42d UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:48:15.066350597Z 2019-08-07T01:48:15.333043607Z
operation-1565142554731-854552bb UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:49:14.731199466Z 2019-08-07T01:49:14.965500915Z
operation-1565142615204-de04a754 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:50:15.204942154Z 2019-08-07T01:50:15.43064853Z
operation-1565142675193-26f83fa3 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:51:15.193532854Z 2019-08-07T01:51:15.440081548Z
operation-1565142734971-af828cad UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:52:14.97156355Z 2019-08-07T01:52:15.237550159Z
operation-1565142794704-e46c522e UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:53:14.704849985Z 2019-08-07T01:53:14.96576061Z
operation-1565142855332-2759c09e UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:54:15.332868373Z 2019-08-07T01:54:15.612238242Z
operation-1565142915278-c2b85d6f UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:55:15.278071544Z 2019-08-07T01:55:15.496593655Z
operation-1565142974856-d57eadc7 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:56:14.856958074Z 2019-08-07T01:56:15.157866349Z
operation-1565143034429-e08a2fe7 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:57:14.429146941Z 2019-08-07T01:57:14.653713985Z
operation-1565143094519-d0b413ca UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:58:14.519593054Z 2019-08-07T01:58:15.081263171Z
operation-1565143155112-396a9905 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T01:59:15.112608779Z 2019-08-07T01:59:15.379472501Z
operation-1565143215528-cb095059 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:00:15.52844131Z 2019-08-07T02:00:15.762096486Z
operation-1565143274782-acce1825 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:01:14.782245493Z 2019-08-07T02:01:15.075211239Z
operation-1565143334754-8e434afb UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:02:14.754331507Z 2019-08-07T02:02:14.992808313Z
operation-1565143394679-906f34bd UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:03:14.679565515Z 2019-08-07T02:03:15.091204962Z
operation-1565143455215-c0b027c3 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:04:15.215649406Z 2019-08-07T02:04:15.462525993Z
operation-1565143515404-174a06e4 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:05:15.404961545Z 2019-08-07T02:05:15.626967407Z
operation-1565143575216-40a11d67 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:06:15.216297616Z 2019-08-07T02:06:15.439134998Z
operation-1565143635290-1cff91ce UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:07:15.290497447Z 2019-08-07T02:07:15.545050154Z
operation-1565143694508-ac61e122 UPDATE_CLUSTER europe-west2-a test-cluster DONE 2019-08-07T02:08:14.508367367Z 2019-08-07T02:08:14.814808285Z
Looking at one of these operations,
endTime: '2019-08-07T02:03:15.091204962Z'
name: operation-1565143394679-906f34bd
operationType: UPDATE_CLUSTER
selfLink: https://container.googleapis.com/v1/projects/791218390362/zones/europe-west2-a/operations/operation-1565143394679-906f34bd
startTime: '2019-08-07T02:03:14.679565515Z'
status: DONE
targetLink: https://container.googleapis.com/v1/projects/791218390362/zones/europe-west2-a/clusters/test-cluster
zone: europe-west2-a
Any help is appreciated.