Anonymous-auth: "false" preventing node from joining cluster

Cluster information:

Kubernetes version: 1.20
Cloud being used: bare-metal
Installation method: kubeadm
Host OS: CentOS 8
CNI and version: Calico
CRI and version: Containerd

After setting anonymous-auth false and trying to join a new control plane node I get the following errors:
Failed to request cluster-info, will try again: Unauthorized
I1230 16:48:36.701531 1242177 round_trippers.go:445] GET

I saw similar issues with trying to initialize the cluster with that parameter as well. I have the certs and authorization set to Node and RBAC. What would be preventing a node from authenticating when I have the tokens, certs, etc.?

I was able to fix it by removing that setting. One of the reasons I set it was because it was flagged in a CIS benchmark as a fail, however if I enable it, it seems to break the cluster.

I did see another thread that indicated Kubernetes was secure even with this set to true. Seems counterintuitive though.