To save costs on machines, I didn't add public IPv4 addresses the servers and only IPv6, and seemingly github doesn't support IPv6 requests and only IPv4.
Now I have to manually export images as tar to the worker machines and import them there.
It's fun
