visualization Of Layers Tanh tanh(Wx+b) A linear transformation by the “weight” matrix W A translation by the vector b Point-wise application of Tanh.