- Both abc
- Gets more interesting when it is Chinese to Arabic for example. Different symbols + one is read left to right the other right to left
- Memory challenge
- By the time the model gets to the end of the sentence, the signal from the beginning of the sentence is not as strong
- 10-20 words was okay, but after that really bad
- Now, keep and modify the full sentence
- distill.pub/2016/augmented-rnns/
- https://cameronrwolfe.substack.com/p/understanding-and-using-supervised
- Memory challenge
