I try to train a sample net

[ChengTsang]

Hello,
I trained a super net on cifar to get the suitable theta, then I try to retrain a sample net only to find the output of each layer to be NAN for just 3 batch. Do you have met this situation before? What should I do?
Thanks.

[JunrQ]

Some advices:

• adjust learning rate
• add bn after conv
• maybe there are bugs in your code

[ChengTsang]

Thanks for your advices.