Toggle Light / Dark / Auto color theme

Toggle table of contents sidebar

Recursive Neural Network

Modern RNN is complicate for its implementation, especially the shape of data pass in and out. This note will record some famous RNN:

• RNN

• GRU

• LSTM

• Attension Mechanism

• Self-attension

• Transformer

• BERT