Kubernetes Pods in EKS in a VPC taking 5+ seconds to Connect to Database in another VPC

We are running few business server pods (in a EKS cluster in a VPC) that connect to an Aurora PostgreSQL database in another VPC in the same region in the same AWS account. The business server connects to the database using psql ODBC driver. We have seen that the initial connection to database is taking 5+ seconds, while the database log shows less than 1 sec for receiving connection request and authorizing the connection. Also, the same business server running as a process in the VPC where database exists, takes less than 100 milliseconds to open connection to database

Question : We would like to understand why is it taking 5+ seconds for Pods to connects to DB (in different VPC) where DB is taking less than a second to establish the connection ?

Cluster information:

Kubernetes version: 1.18
Cloud being used: (put bare-metal if not on a public cloud) AWS EKS
Installation method: managed
Host OS: Linux
CNI and version: AWS VPC CNI 1.7.5
CRI and version: docker