How many Epochs for decoder training?

Hi team thanks for the repository. I would have been still more happier had you provided steps to train the encoder as well. Anyway with the pre-trained encoder, I just tried to train the decoder with 110 epochs as mentioned in the code. But the output is a whispered speech. Can you pls let me know what epoch I should set to train the decoder to get an intelligible voice? Thanks in advance :) 