Hi!
I have a problem when joining nodes to a master.
kubeadm join 10.0.100.56:6443 --token zbtew1.onkqkc5ivy89ua8p --discovery-token-ca-cert-hash sha256:0f74c4cbb87085d25b2c752f080d87a13ea54165b947efbe9004d36a22e21d03 --v=9
I1004 08:21:53.143847 1937942 join.go:405] [preflight] found NodeName empty; using OS hostname as NodeName
I1004 08:21:53.143920 1937942 initconfiguration.go:116] detected and using CRI socket: /var/run/dockershim.sock
[preflight] Running pre-flight checks
I1004 08:21:53.143990 1937942 preflight.go:92] [preflight] Running general checks
I1004 08:21:53.144030 1937942 checks.go:245] validating the existence and emptiness of directory /etc/kubernetes/manifests
I1004 08:21:53.144070 1937942 checks.go:282] validating the existence of file /etc/kubernetes/kubelet.conf
I1004 08:21:53.144080 1937942 checks.go:282] validating the existence of file /etc/kubernetes/bootstrap-kubelet.conf
I1004 08:21:53.144090 1937942 checks.go:106] validating the container runtime
I1004 08:21:53.212967 1937942 checks.go:132] validating if the "docker" service is enabled and active
I1004 08:21:53.235990 1937942 checks.go:331] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I1004 08:21:53.236117 1937942 checks.go:331] validating the contents of file /proc/sys/net/ipv4/ip_forward
I1004 08:21:53.236166 1937942 checks.go:649] validating whether swap is enabled or not
I1004 08:21:53.236218 1937942 checks.go:372] validating the presence of executable conntrack
I1004 08:21:53.236257 1937942 checks.go:372] validating the presence of executable ip
I1004 08:21:53.236287 1937942 checks.go:372] validating the presence of executable iptables
I1004 08:21:53.236317 1937942 checks.go:372] validating the presence of executable mount
I1004 08:21:53.236345 1937942 checks.go:372] validating the presence of executable nsenter
I1004 08:21:53.236374 1937942 checks.go:372] validating the presence of executable ebtables
I1004 08:21:53.236402 1937942 checks.go:372] validating the presence of executable ethtool
I1004 08:21:53.236425 1937942 checks.go:372] validating the presence of executable socat
I1004 08:21:53.236454 1937942 checks.go:372] validating the presence of executable tc
I1004 08:21:53.236477 1937942 checks.go:372] validating the presence of executable touch
I1004 08:21:53.236508 1937942 checks.go:520] running all checks
I1004 08:21:53.323819 1937942 checks.go:403] checking whether the given node name is valid and reachable using net.LookupHost
I1004 08:21:53.324210 1937942 checks.go:618] validating kubelet version
I1004 08:21:53.414672 1937942 checks.go:132] validating if the "kubelet" service is enabled and active
I1004 08:21:53.440438 1937942 checks.go:205] validating availability of port 10250
I1004 08:21:53.440753 1937942 checks.go:282] validating the existence of file /etc/kubernetes/pki/ca.crt
I1004 08:21:53.440786 1937942 checks.go:432] validating if the connectivity type is via proxy or direct
I1004 08:21:53.440858 1937942 join.go:475] [preflight] Discovering cluster-info
I1004 08:21:53.440930 1937942 token.go:80] [discovery] Created cluster-info discovery client, requesting info from "10.0.100.56:6443"
I1004 08:21:53.442246 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:21:53.443735 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:21:53.443767 1937942 round_trippers.go:460] Response Headers:
I1004 08:21:53.443893 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 1 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:21:54.444296 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:21:54.445614 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:21:54.445644 1937942 round_trippers.go:460] Response Headers:
I1004 08:21:54.445719 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 2 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:21:55.446009 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:21:55.447301 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:21:55.447355 1937942 round_trippers.go:460] Response Headers:
I1004 08:21:55.447453 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 3 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:21:56.447797 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:21:56.449136 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:21:56.449165 1937942 round_trippers.go:460] Response Headers:
I1004 08:21:56.449241 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 4 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:21:57.449508 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:21:57.450849 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:21:57.450878 1937942 round_trippers.go:460] Response Headers:
I1004 08:21:57.450948 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 5 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:21:58.452118 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:21:58.453870 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:21:58.453899 1937942 round_trippers.go:460] Response Headers:
I1004 08:21:58.453978 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 6 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:21:59.454250 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:21:59.455639 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:21:59.455668 1937942 round_trippers.go:460] Response Headers:
I1004 08:21:59.455743 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 7 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:22:00.456036 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:22:00.457315 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:22:00.457346 1937942 round_trippers.go:460] Response Headers:
I1004 08:22:00.457473 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 8 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:22:01.457760 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:22:01.458947 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:22:01.458976 1937942 round_trippers.go:460] Response Headers:
I1004 08:22:01.459050 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 9 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:22:02.459298 1937942 round_trippers.go:435] curl -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I1004 08:22:02.460660 1937942 round_trippers.go:454] GET https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in 1 milliseconds
I1004 08:22:02.460689 1937942 round_trippers.go:460] Response Headers:
I1004 08:22:02.460771 1937942 with_retry.go:171] Got a Retry-After 1s response for attempt 10 to https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s
I1004 08:22:03.461281 1937942 token.go:217] [discovery] Failed to request cluster-info, will try again: context deadline exceeded
Opening the address https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s in a browser works perfectly.
{
"kind": "ConfigMap",
"apiVersion": "v1",
"metadata": {
"name": "cluster-info",
"namespace": "kube-public",
"uid": "dcc792b2-0a1c-4d44-b223-5736417815f4",
"resourceVersion": "416",
"creationTimestamp": "2021-10-04T07:18:05Z",
"managedFields": [
{
"manager": "kubeadm",
"operation": "Update",
"apiVersion": "v1",
"time": "2021-10-04T07:18:05Z",
"fieldsType": "FieldsV1",
"fieldsV1": {"f:data":{".":{},"f:kubeconfig":{}}}
},
{
"manager": "kube-controller-manager",
"operation": "Update",
"apiVersion": "v1",
"time": "2021-10-04T07:18:19Z",
"fieldsType": "FieldsV1",
"fieldsV1": {"f:data":{"f:jws-kubeconfig-zbtew1":{}}}
}
]
},
"data": {
"jws-kubeconfig-zbtew1": "eyJhbGciOiJIUzI1NiIsImtpZCI6InpidGV3MSJ9..6MhXIjCP3ibd2RkWvnIF7gS7zbIR60PFUCozWmEOnCU",
"kubeconfig": "apiVersion: v1\nclusters:\n- cluster:\n certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvakNDQWVhZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1UQXdOREEzTVRjMU1Gb1hEVE14TVRBd01qQTNNVGMxTUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUhZCkFYYXpJQ0YzQmI2NG1zQVVKTWFqWmpJMHZzY2RrdFliTEo4MWhkb24rMHlFQ2dWaVdybUNkeWJvWk8wREo3L0gKa1lubXdiNTR2OHlZbTdoVlVORE9rY3Q2NzdPckVHMHhsSjN6Nmg5b1J4WXErUHIvamY4MVdwdi85b1ZEcU1BYgpkVzFSNGgrTWZjWUR1N0NYNzJEbjlLdHNXV0RhOVVqNks3aEJFd2o2dW5UMi9rYnVpZlVvc3A4dkRSVnlaMllpCktVUmd5K3IrVjhVc1ZnY2xQV0FFejczNUZjU0tVUmNmKy84dnh1RWVybEpjeEFUMDg2WWowdytEY0d3MTgrZmwKVjRsNDhLUmtwRkJUVXMrTEVCbmVjUnpQWDFkMERxT1JobENPb3VIVTlHWm8veDBQN2I0WGxqczNxejEvN2o4LwpNcVo2SmVJMEVUd2pQMjc5TGpzQ0F3RUFBYU5aTUZjd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZJQnBJUmp2bkE0cjBqZ3UyVUpPUnhjV3F4ZDZNQlVHQTFVZEVRUU8KTUF5Q0NtdDFZbVZ5Ym1WMFpYTXdEUVlKS29aSWh2Y05BUUVMQlFBRGdnRUJBSUZrM2NFOFVlaGQxL2o2bHZzKwpFV3Q1MVZidy9OWjN3NHRFOWQwUHJjeWd0c095ZFJ4YjAvcm5nenJSalJUL3BFY1dNMHFLczF6V2h5YUZmM1MzCkNJZDlLUnNPRk1mcldIamZCbE9sQXZJQ1ZMMEdDWFp2NytyZ1BkaFBiZC84bmFGemJhcUI5NExnR2Z4R3oreEUKNVZTaXBuREdaVWFMK2ZtdksvK21QVUIwdXRISVRBUG53eTM0RWFnbFhreTM5aFZEc3BWM1hTTVJ0OTNJSFZuMApGeEZyKzJtOG1nN3ZESjJselhUUHU4NGVPa242YXZUZmtCWVlEWmZkYkIxVlk5bVdna0JreG5BNVBjcmQ0TnB4CnF6MEdkMEM2emVWcEs4dU9zN0srdDRuNFl3V1ZLSGVyclpXQjdIYVRQemtZMFRNK3MxRGptSDJMWkcvdkpOcjAKL0RrPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==\n server: https://10.0.100.56:6443\n name: \"\"\ncontexts: null\ncurrent-context: \"\"\nkind: Config\npreferences: {}\nusers: null\n"
}
}
But there seem to be problems with SSL:
xadm@node1:~$ curl -v -XGET -H "User-Agent: kubeadm/v1.22.2 (linux/amd64) kubernetes/8b5a191" -H "Accept: application/json, */*" 'https://10.0.100.56:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
Note: Unnecessary use of -X or --request, GET is already inferred.
* Trying 10.0.100.56:6443...
* TCP_NODELAY set
* Connected to 10.0.100.56 (10.0.100.56) port 6443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
* CAfile: /etc/ssl/certs/ca-certificates.crt
CApath: /etc/ssl/certs
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* OpenSSL SSL_connect: Connection reset by peer in connection to 10.0.100.56:6443
* Closing connection 0
curl: (35) OpenSSL SSL_connect: Connection reset by peer in connection to 10.0.100.56:6443
xadm@node1:~$ curl -X GET https://10.0.100.56:6443/healthz -k
curl: (35) OpenSSL SSL_connect: Connection reset by peer in connection to 10.0.100.56:6443
xadm@node1:~$ openssl s_client 10.0.100.56:6443
CONNECTED(00000003)
write:errno=104
---
no peer certificate available
---
No client certificate CA names sent
---
SSL handshake has read 0 bytes and written 0 bytes
Verification: OK
---
New, (NONE), Cipher is (NONE)
Secure Renegotiation IS NOT supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
Early data was not sent
Verify return code: 0 (ok)
---
I have this problem on all nodes.
I hope someone can help me.
Cluster information:
Kubernetes version: 1.22
Cloud being used: bare-metal
Installation method: How to Install Kubernetes(K8s) and Docker on Ubuntu 20.04 - LetsCloud Community
Host OS: Ubuntu 20.04.3