Pods on different nodes are unable to communicate with each other | same nodes works well

General Discussions
1

Cluster information:

Kubernetes version: v1.32.2
Cloud being used: put bare-metal (VMs created on Openstack cloud)
Installation method: kubeadm
Host OS: Ubuntu: 22.04
CNI and version: calicoctl version
Client Version: v3.20.1
Release: Calico Enterprise

CRI and version: Containerd:v2.0.3

ISSUE

  • I have a master and two worker nodes.
  • pods on same node can communicate with each other (ping)
  • pods on different nodes can’t communicate with each other

TROUBLESHOOTING DONE

  1. reinstalled CNI (calico)
  2. Pods have been assigned IPs from designated CIDR
  3. Firewall is off/disabled
  4. node-node connectivity is good
  5. deleted all network policies and created a new one which allows all traffic
1 Like