Driver doesn't support SRIOV configuration via sysfs #19
Description
We have a Mellanox ConnectX-3 dual port nic.
We're following this guide: https://community.mellanox.com/s/article/reference-deployment-guide-for-k8s-cluster-with-mellanox-rdma-device-plugin-and-multus-cni-plugin-with-two-network-interfaces--flannel-and-mellanox-sr-iov---draft-x
Everything runs smoothly, until I activate the device plugin. The plugin installs fine, but when I look at the logs I see
/sys/class/net/eth2/device/sriov_numvfs: Function not implemented
I did manually what I think the plugin does on each physical node running k8s. For example,
echo 8 | sudo tee /sys/class/net/eth2/device/sriov_numvfs
I always get the same error:
/sys/class/net/eth2/device/sriov_numvfs: Function not implemented
Also, if I do
dmesg | grep -i mlx
I see this error:
mlx4_core 0000:03:00.0: Driver doesn't support SRIOV configuration via sysfs.
As an experiment, I've also tried to activate VFs through the mlx_core driver configuration (as for example described here: https://community.mellanox.com/s/article/howto-configure-sr-iov-for-connectx-3-with-kvm--ethernet-x).
In this case VFs come up and everything works fine, but unfortunately this doesn't seem to be compatible with the SRIOV device plugin.
This is really blocking us..any suggestion would be highly appreciated!
Thanks.