Big docker image take almost an hour to pull in a k8s cluster

Asking for help? Comment out what you need so we can get more information to help you!

Cluster information:

Kubernetes version: v1.18.12-gke.1210
Cloud being used: (put bare-metal if not on a public cloud) gke
Installation method: Google cloud console
Host OS: container optimized os
CNI and version:
CRI and version:

Hello,

We are having a hard time running k8s jobs that use a 30 GB image. The image takes up to 50 minutes to be pulled on a newly created node. Reducing the image size is not an option and the pull time is bound by decompression, not download, so local registries won’t help. We use autoscaling to allocate resources on demand but this is irritating because running a job that takes 5 minutes will take almost one hour if the node is newly created. Any way to deal with that?

Thanks in advance.