minikube start failed when using ssh driver connecting to a different arch remote vm

[chengzhycn]

What Happened?

Hello! I am using minikube at my macmini which is aarch64 and the start command is below:

minikube start --cni='cilium' --cri-socket='/run/containerd/containerd.sock' --cpus=8 --driver='ssh' ...

The remote vm is located at an remote x86_64 machine:

Linux minikube 6.8.0-57-generic #59~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Mar 19 17:07:41 UTC 2 x86_64 x86_64 x86_64 GNU/Linux

It started failed, and report the kubelet/kubeadm/kubectl "Exec format error". So I checked the binaries' format, they are aarch64:

# readelf -h kubectl 
ELF Header:
  Magic:   7f 45 4c 46 02 01 01 00 00 00 00 00 00 00 00 00 
  Class:                             ELF64
  Data:                              2's complement, little endian
  Version:                           1 (current)
  OS/ABI:                            UNIX - System V
  ABI Version:                       0
  Type:                              EXEC (Executable file)
  Machine:                           AArch64

I think the downloaded binaries should match the target vm's architecture rather than the host's architecture.

Thanks.

Attach the log file

==> kubelet <==
5月 10 14:12:41 minikube systemd[64750]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:41 minikube systemd[64750]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:41 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:41 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
5月 10 14:12:41 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1141.
5月 10 14:12:41 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
5月 10 14:12:41 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
5月 10 14:12:41 minikube systemd[64752]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:41 minikube systemd[64752]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:41 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:41 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
5月 10 14:12:42 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1142.
5月 10 14:12:42 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
5月 10 14:12:42 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
5月 10 14:12:42 minikube systemd[64754]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:42 minikube systemd[64754]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:42 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:42 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
5月 10 14:12:43 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1143.
5月 10 14:12:43 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
5月 10 14:12:43 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
5月 10 14:12:43 minikube systemd[64756]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:43 minikube systemd[64756]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:43 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:43 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
5月 10 14:12:44 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1144.
5月 10 14:12:44 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
5月 10 14:12:44 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
5月 10 14:12:44 minikube systemd[64758]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:44 minikube systemd[64758]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:44 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:44 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
5月 10 14:12:44 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1145.
5月 10 14:12:44 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
5月 10 14:12:44 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
5月 10 14:12:44 minikube systemd[64760]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:44 minikube systemd[64760]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:44 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:44 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
5月 10 14:12:45 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1146.
5月 10 14:12:45 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
5月 10 14:12:45 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
5月 10 14:12:45 minikube systemd[64763]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:45 minikube systemd[64763]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:45 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:45 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
5月 10 14:12:46 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1147.
5月 10 14:12:46 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
5月 10 14:12:46 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
5月 10 14:12:46 minikube systemd[64765]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:46 minikube systemd[64765]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:46 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:46 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
5月 10 14:12:47 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1148.
5月 10 14:12:47 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
5月 10 14:12:47 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
5月 10 14:12:47 minikube systemd[64915]: kubelet.service: Failed to execute /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:47 minikube systemd[64915]: kubelet.service: Failed at step EXEC spawning /var/lib/minikube/binaries/v1.32.0/kubelet: Exec format error
5月 10 14:12:47 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=203/EXEC
5月 10 14:12:47 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.

Operating System

macOS (Default)

Driver

SSH

[afbjorklund]

Different architectures are currently not supported.