Restart provider Deployment to load updated variables #870
Description
User Story
As a user, I would like the providers to be adopt updated environment variables automatically, so that I can simply update credentials without need to perform any other action.
Detailed Description
Taking CAPA as example, each provider may specify environment variables to configure it.
The user should be able to just edit these variables in the referenced configSecret, and have any provider pods picking them up.
Currently, updating for example the AWS_B64ENCODED_CREDENTIALS will actually make CAPI operator generate an updated manifest, which is going to be applied, however this will only change the capa-manager-bootstrap-credentials Secret and will not affect the Deployment, which will then not restart.
The provider could periodically or always fetch updated credentials, the secret volume will eventually be refreshed, however I assume most providers will load envs at boot only.
For this reason it would be nice to always restart the deployment when an updated manifest is applied.
This could also be a toggable feature, which I would personally default to true, and could look like:
apiVersion: operator.cluster.x-k8s.io/v1alpha2
kind: InfrastructureProvider
metadata:
name: aws
namespace: capa-system
spec:
forceRestartOnUpdate: true
Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]
/kind feature