Unable to connect to ( master ip + port ) on master node

Asking for help? Comment out what you need so we can get more information to help you!

Cluster information:

Kubernetes version: 1.15.3
Cloud being used: (put bare-metal if not on a public cloud) AWS
Installation method: Ansible
Host OS: Red Hat Enterprise Linux Server release 7.9 (Maipo)
CNI and version: 10-flannel.conflist
CRI and version: docker://18.9.9

On Master node I’m tring to connect to 30888 with localhost.
image

But If I’m tring to connect same port on worker node its connecting.

[root@STLAWSXAI03 ysudhir]# telnet 127.0.0.1 30888
Trying 127.0.0.1...
Connected to 127.0.0.1.
Escape character is '^]'.
^CConnection closed by foreign host.

Logs in journalctl -xeu kubelet

Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.468798   11932 kuberuntime_manager.go:928] updating runtime config through cri with podcidr 10.244.0.0/24
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.468964   11932 docker_service.go:353] docker cri received runtime config &RuntimeConfig{NetworkConfig:&Networ
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.469113   11932 kubelet_network.go:77] Setting Pod CIDR:  -> 10.244.0.0/24
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: E1018 08:55:18.499068   11932 reflector.go:125] object-"kube-system"/"flannel-token-2g6q2": Failed to list *v1.Secret: secre
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: E1018 08:55:18.499135   11932 reflector.go:125] object-"kube-system"/"kube-flannel-cfg": Failed to list *v1.ConfigMap: confi
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: E1018 08:55:18.499182   11932 reflector.go:125] object-"kube-system"/"coredns": Failed to list *v1.ConfigMap: configmaps "co
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: E1018 08:55:18.499218   11932 reflector.go:125] object-"kube-system"/"coredns-token-d5wx4": Failed to list *v1.Secret: secre
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: E1018 08:55:18.499566   11932 reflector.go:125] object-"kube-system"/"kube-proxy-token-45bkr": Failed to list *v1.Secret: se
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: E1018 08:55:18.499623   11932 reflector.go:125] object-"kube-system"/"kube-proxy": Failed to list *v1.ConfigMap: configmaps
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.582777   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "flanne
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.582831   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "flanne
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.582862   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "run" (
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.582890   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "cni" (
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.582919   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "config
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.582948   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "coredn
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.582973   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "flanne
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.582998   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "flanne
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.583025   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "run" (
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.583050   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "cni" (
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.583076   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-p
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.583104   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-p
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.583128   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "xtable
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.583154   11932 reconciler.go:203] operationExecutor.VerifyControllerAttachedVolume started for volume "lib-mo
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.583168   11932 reconciler.go:150] Reconciler: start to sync state
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.720943   11932 kubelet_node_status.go:114] Node stlawsxai01 was previously registered
Oct 18 08:55:18 STLAWSXAI01 kubelet[11932]: I1018 08:55:18.721046   11932 kubelet_node_status.go:75] Successfully registered node stlawsxai01
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688212   11932 configmap.go:203] Couldn't get configMap kube-system/kube-flannel-cfg: couldn't propagate obje
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688361   11932 nestedpendingoperations.go:270] Operation for "\"kubernetes.io/configmap/34169b63-cb9b-412b-8
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688422   11932 secret.go:198] Couldn't get secret kube-system/flannel-token-2g6q2: couldn't propagate object
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688486   11932 nestedpendingoperations.go:270] Operation for "\"kubernetes.io/secret/34169b63-cb9b-412b-8770-
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688507   11932 secret.go:198] Couldn't get secret kube-system/kube-proxy-token-45bkr: couldn't propagate obje
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688550   11932 nestedpendingoperations.go:270] Operation for "\"kubernetes.io/secret/bb29d169-0ac5-4782-928d-
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688567   11932 configmap.go:203] Couldn't get configMap kube-system/kube-proxy: couldn't propagate object cac
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688620   11932 nestedpendingoperations.go:270] Operation for "\"kubernetes.io/configmap/bb29d169-0ac5-4782-92
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688644   11932 configmap.go:203] Couldn't get configMap kube-system/kube-flannel-cfg: couldn't propagate obje
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688685   11932 nestedpendingoperations.go:270] Operation for "\"kubernetes.io/configmap/656541ca-c19b-4674-b7
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688719   11932 secret.go:198] Couldn't get secret kube-system/flannel-token-2g6q2: couldn't propagate object
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688760   11932 nestedpendingoperations.go:270] Operation for "\"kubernetes.io/secret/656541ca-c19b-4674-b75e-
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688778   11932 configmap.go:203] Couldn't get configMap kube-system/coredns: couldn't propagate object cache:
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688818   11932 nestedpendingoperations.go:270] Operation for "\"kubernetes.io/configmap/07bc1632-d4b7-46e9-91
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688836   11932 secret.go:198] Couldn't get secret kube-system/coredns-token-d5wx4: couldn't propagate object
Oct 18 08:55:19 STLAWSXAI01 kubelet[11932]: E1018 08:55:19.688875   11932 nestedpendingoperations.go:270] Operation for "\"kubernetes.io/secret/07bc1632-d4b7-46e9-9178-
Oct 18 08:55:20 STLAWSXAI01 kubelet[11932]: W1018 08:55:20.313476   11932 kuberuntime_container.go:691] No ref for container {"docker" "d3498175b47219e6fa08dc39982a1062
Oct 18 08:55:20 STLAWSXAI01 kubelet[11932]: W1018 08:55:20.574165   11932 cni.go:309] CNI failed to retrieve network namespace path: cannot find network namespace for t
Oct 18 08:55:21 STLAWSXAI01 kubelet[11932]: W1018 08:55:21.325861   11932 pod_container_deletor.go:75] Container "f1e89f46946064c4d3d1a5d309bd8b400bd623630aff311c905717
Oct 18 12:34:57 STLAWSXAI01 kubelet[11932]: W1018 12:34:57.523479   11932 reflector.go:302] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: watch of *v1.Pod ended
Oct 18 17:52:06 STLAWSXAI01 kubelet[11932]: W1018 17:52:06.578242   11932 reflector.go:302] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: watch of *v1.Pod ended
Oct 18 23:11:52 STLAWSXAI01 kubelet[11932]: W1018 23:11:52.635685   11932 reflector.go:302] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: watch of *v1.Pod ended
Oct 19 04:31:29 STLAWSXAI01 kubelet[11932]: W1019 04:31:29.686957   11932 reflector.go:302] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: watch of *v1.Pod ended

Can you please tell, is there any configuration issue I need to check or any port need to open in my security group.