RNN

this is a recurrent neural network.

it reads characters one at a time, and predicts the next character.

it remembers recent characters by using feedback.

Learning Curves

dots: shows which input characters generated prediction error. error should decay over time.

right: vocabulary