SRN

  • Just a simple RNN Cell
  • Vanishingexploding gradients , in Backprop, they break down when sequences are long.
  • Distance between the relevant words are too long
  • Followed up [LSTM)](Long Short Term Memory (LSTM|Long Short Term Memory (LSTM|LSTM)](LSTM)](Long Short Term Memory (LSTM|Long Short Term Memory (LSTM|LSTM).md).md)