memory problem

[keithyin]

Such a wonderful work, I learned a lot from it. thanks @soobinseo
I have encountered a problem when running the program. My GPU has 12G memory, but when the batch size larger than one, out of memory error will occur.
I tried to use inplace=True for all relu activation function, but it seems useless. all the remaining hyperparameter stay the same with the origin provided.
Any suggestions for this problem, Thanks!

[sunnnnnnnny]

the original batch_size is 32,you can reduce it to 8 or 16.