SLIDE 1
Text Sentiment Analysis with rNN on the IMDB Dataset
PyTorch and TensorFlow Comparative Evaluation
Stefanos Laskaridis
sl829@cam.ac.uk R244: Large-Scale Data Processing and Optimisation
Recurrent Neural Networks
unweighted connection
Legend
weighted connection connection with time-lag mutliplication
+
sum over all inputs branching point gate activation function (always sigmoid)
+ +
+
+
forget gate input gate block input cell
+
- utput gate
peepholes
LSTM block g h
...input
... ... ... ... . . . . . . ... . . .recurrent
. . .input recurrent input recurrent input recurrent
- utput
recurrent
+ g SRN unit
...input
...recurrent
... . . .- utput
recurrent
g
input activation function (usually tanh)
h
- utput activation function
(usually tanh) block output
2
Images taken from [5] and [6]