Unable to join a node to an existing cluster, errors in daemon-cluster-agent log

Hi folks,

I’m trying to build a 2 node cluster but the node fails to join the master.

I’ve verified that all relevant ports on the master are open and can be reached from the new node.

I’ll provide the recent logs below.

Any help is greatly appreciated :wink:

Regards,
Daniel

sudo journalctl | grep microk8s.daemon-cluster-agent

Jun 02 20:09:57 some-master systemd[1]: snap.microk8s.daemon-cluster-agent.service: Succeeded.
Jun 02 20:09:57 some-master systemd[1]: Stopped Service for snap application microk8s.daemon-cluster-agent.
Jun 02 20:10:19 some-master systemd[1]: Started Service for snap application microk8s.daemon-cluster-agent.
Jun 02 20:10:20 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:10:20 +0200] [303120] [INFO] Starting gunicorn 19.4.5
Jun 02 20:10:20 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:10:20 +0200] [303120] [INFO] Listening at: https://0.0.0.0:25000 (303120)
Jun 02 20:10:20 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:10:20 +0200] [303120] [INFO] Using worker: sync
Jun 02 20:10:20 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:10:20 +0200] [303683] [INFO] Booting worker with pid: 303683
Jun 02 20:11:31 some-master microk8s.daemon-cluster-agent[302916]: Waiting for access to cluster.
Jun 02 20:11:31 some-master microk8s.daemon-cluster-agent[302916]: Waiting for access to cluster.
Jun 02 20:11:32 some-master microk8s.daemon-cluster-agent[302916]: Waiting for access to cluster. Warning: apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:19:46 +0200] [303683] [ERROR] Exception in worker process:
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: Traceback (most recent call last):
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 129, in handle
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     req = six.next(parser)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/parser.py", line 41, in __next__
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.mesg = self.mesg_class(self.cfg, self.unreader, self.req_count)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 153, in __init__
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     super(Request, self).__init__(cfg, unreader)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 53, in __init__
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     unused = self.parse(self.unreader)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 165, in parse
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.get_data(unreader, buf, stop=True)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 156, in get_data
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     data = unreader.read()
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/unreader.py", line 38, in read
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     d = self.chunk()
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/unreader.py", line 65, in chunk
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     return self.sock.recv(self.mxchunk)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 914, in recv
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     return self.read(buflen)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 791, in read
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     return self._sslobj.read(len, buffer)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 577, in read
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     v = self._sslobj.read(len)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1981)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: During handling of the above exception, another exception occurred:
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: Traceback (most recent call last):
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/arbiter.py", line 515, in spawn_worker
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     worker.init_process()
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/base.py", line 126, in init_process
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.run()
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 119, in run
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.run_for_one(timeout)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 66, in run_for_one
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.accept(listener)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 30, in accept
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.handle(listener, client, addr)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 141, in handle
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.handle_error(req, client, addr, e)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/base.py", line 213, in handle_error
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.log.exception("Error handling request %s", req.uri)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: AttributeError: 'NoneType' object has no attribute 'uri'
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: Traceback (most recent call last):
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 129, in handle
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     req = six.next(parser)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/parser.py", line 41, in __next__
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.mesg = self.mesg_class(self.cfg, self.unreader, self.req_count)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 153, in __init__
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     super(Request, self).__init__(cfg, unreader)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 53, in __init__
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     unused = self.parse(self.unreader)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 165, in parse
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.get_data(unreader, buf, stop=True)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 156, in get_data
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     data = unreader.read()
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/unreader.py", line 38, in read
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     d = self.chunk()
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/unreader.py", line 65, in chunk
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     return self.sock.recv(self.mxchunk)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 914, in recv
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     return self.read(buflen)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 791, in read
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     return self._sslobj.read(len, buffer)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 577, in read
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     v = self._sslobj.read(len)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1981)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: During handling of the above exception, another exception occurred:
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: Traceback (most recent call last):
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/arbiter.py", line 515, in spawn_worker
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     worker.init_process()
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/base.py", line 126, in init_process
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.run()
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 119, in run
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.run_for_one(timeout)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 66, in run_for_one
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.accept(listener)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 30, in accept
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.handle(listener, client, addr)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 141, in handle
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.handle_error(req, client, addr, e)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/base.py", line 213, in handle_error
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:     self.log.exception("Error handling request %s", req.uri)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: AttributeError: 'NoneType' object has no attribute 'uri'
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:19:46 +0200] [303683] [INFO] Worker exiting (pid: 303683)
Jun 02 20:19:46 some-master microk8s.daemon-cluster-agent[302916]:
Jun 02 20:19:47 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:19:47 +0200] [342131] [INFO] Booting worker with pid: 342131
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:23:56 +0200] [342131] [ERROR] Exception in worker process:
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: Traceback (most recent call last):
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 129, in handle
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     req = six.next(parser)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/parser.py", line 41, in __next__
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.mesg = self.mesg_class(self.cfg, self.unreader, self.req_count)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 153, in __init__
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     super(Request, self).__init__(cfg, unreader)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 53, in __init__
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     unused = self.parse(self.unreader)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 165, in parse
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.get_data(unreader, buf, stop=True)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 156, in get_data
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     data = unreader.read()
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/unreader.py", line 38, in read
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     d = self.chunk()
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/unreader.py", line 65, in chunk
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     return self.sock.recv(self.mxchunk)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 914, in recv
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     return self.read(buflen)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 791, in read
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     return self._sslobj.read(len, buffer)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 577, in read
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     v = self._sslobj.read(len)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1981)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: During handling of the above exception, another exception occurred:
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: Traceback (most recent call last):
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/arbiter.py", line 515, in spawn_worker
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     worker.init_process()
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/base.py", line 126, in init_process
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.run()
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 119, in run
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.run_for_one(timeout)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 66, in run_for_one
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.accept(listener)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 30, in accept
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.handle(listener, client, addr)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 141, in handle
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.handle_error(req, client, addr, e)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/base.py", line 213, in handle_error
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.log.exception("Error handling request %s", req.uri)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: AttributeError: 'NoneType' object has no attribute 'uri'
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: Traceback (most recent call last):
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 129, in handle
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     req = six.next(parser)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/parser.py", line 41, in __next__
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.mesg = self.mesg_class(self.cfg, self.unreader, self.req_count)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 153, in __init__
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     super(Request, self).__init__(cfg, unreader)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 53, in __init__
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     unused = self.parse(self.unreader)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 165, in parse
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.get_data(unreader, buf, stop=True)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/message.py", line 156, in get_data
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     data = unreader.read()
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/unreader.py", line 38, in read
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     d = self.chunk()
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/http/unreader.py", line 65, in chunk
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     return self.sock.recv(self.mxchunk)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 914, in recv
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     return self.read(buflen)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 791, in read
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     return self._sslobj.read(len, buffer)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3.5/ssl.py", line 577, in read
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     v = self._sslobj.read(len)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1981)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: During handling of the above exception, another exception occurred:
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: Traceback (most recent call last):
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/arbiter.py", line 515, in spawn_worker
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     worker.init_process()
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/base.py", line 126, in init_process
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.run()
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 119, in run
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.run_for_one(timeout)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 66, in run_for_one
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.accept(listener)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 30, in accept
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.handle(listener, client, addr)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/sync.py", line 141, in handle
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.handle_error(req, client, addr, e)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:   File "/snap/microk8s/2213/usr/lib/python3/dist-packages/gunicorn/workers/base.py", line 213, in handle_error
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]:     self.log.exception("Error handling request %s", req.uri)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: AttributeError: 'NoneType' object has no attribute 'uri'
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:23:56 +0200] [342131] [INFO] Worker exiting (pid: 342131)
Jun 02 20:23:56 some-master microk8s.daemon-cluster-agent[302916]: [2021-06-02 20:23:56 +0200] [353189] [INFO] Booting worker with pid: 353189

I think the entries from 20:19:46 on are caused by me trying to debug connectivity via curl, not using HTTPS. They can be ignored :wink:

That’s bad because it leaves us only with a few messages and no further hint :frowning:

Jun 02 20:11:31 some-master microk8s.daemon-cluster-agent[302916]: Waiting for access to cluster.
Jun 02 20:11:31 some-master microk8s.daemon-cluster-agent[302916]: Waiting for access to cluster.
Jun 02 20:11:32 some-master microk8s.daemon-cluster-agent[302916]: Waiting for access to cluster. Warning: apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition