LSTM

this is a long short term memory recurrent neural network.

it remembers recent characters by learning how and what to forget and remember.

the first four rows respectively learn to forget, understand, remember and reflect.