May I build an RNN or LSTM network?

[achinastone]

[joaopauloschuler]

@achinastone , although you do not have RNN and LSTM in CAI, you do have the vastly more advanced transformer. You can have a look at these links:

• https://medium.com/@moredevraj370/explore-how-transformer-models-like-gpt-bert-outperform-traditional-rnns-lstms-51a3369141b8
• https://appinventiv.com/blog/transformer-vs-rnn/#:~:text=to%20RNN%20challenges.-,The%20Emergence%20of%20Transformers%20in%20NLP%20%E2%80%93%20A%20Triumph%20Over%20RNN,standard%20in%20the%20AI%20town.
• https://www.kolena.com/guides/transformer-vs-lstm-4-key-differences-and-how-to-choose/#:~:text=Transformers%20generally%20offer%20better%20efficiency,adaptation%20to%20various%20NLP%20tasks.
• https://aws.amazon.com/what-is/transformers-in-artificial-intelligence/#:~:text=In%20contrast%2C%20transformers%20process%20entire,the%20entire%20data%20sequence%20simultaneously.

This is an example of transformers with CAI:

• https://github.com/joaopauloschuler/gpt-3-for-pascal#

[achinastone]

Thanks