So apparently the problem is cause centos8 uses nftables. Thus you have to update the calico-dameonset with the following environment variable
....
Environment:
FELIX_IPTABLESBACKEND: NFT
....
Credits go to https://github.com/rancher/rke/issues/1788#issuecomment-565536201