Sequential Relation Bias

• Sometimes our data has a sequential characteristic. For instance, TIme Series and sentences consist of sequential elements that appear one after another. To model this pattern, we can introduce a Recurrent layer to our network:
•