The architecture of generator is inspired by U-Net: The architecture of the model is symmetric, with n encoding units and n decoding units. The architecture of the generator is shown below:
For discriminator, I used similar architecture as the baselines contractive path.