In the back propagation stage, LSTM uses the time-based back propagation algorithm (BPTT). Training input sampleafter the present, the time elapsed before the neural network to give T transmitted to an output process, the output error by calculating, from t start calculating a gradient layer by layer, the LSTM BPTT algorithm following steps: