Kubectl config set-credentials --exec-arg overwrites existing values

I have a kubeconfig like this

users:
- name: user123
  user:
    exec:
      args:
      - arg1
      - arg2

and I want to add an additional arg (arg3) via kubectl, but when I run kubectl config set-credentials user123 --exec-arg=arg3 it overwrites the existing args and I’m left with kubeconfig like

users:
- name: user123
  user:
    exec:
      args:
      - arg3

Is there a way to append exec args? In my case I will not know exactly what arg1 and arg2 are in advance so I cannot just run kubectl config set-credentials user123 --exec-arg=arg1,arg2,arg3