Currently only the attributes in the __init__ get recorded. If we pass the nn.Module as argument lightning save_hyperparameters() will save the whole model dictionary.
In #273 we had hard-coded some of the model parameters, but this is ugly. An alternative could be using the HyperparametersMixin
as shown here