RNN Formulation & Execution Modes
Visualizing inputs, outputs, and temporal recurrence
๐ค Text/NLP
๐ Time Series
Autoregressive
Non-Autoregressive
Unfold Time Steps (View Outputs)
Run Data Flow
Folded Mode
U
V
W
X
H
O
Feeds back to next input
Feeds back to next input
U
V
W
Xโ
hโโโ
oโโโ
U
V
W
Xโ
hโ
oโ
U
V
Xโ
hโโโ
oโโโ
Variable Breakdown
INPUT (xโ)
--
HIDDEN STATE (hโ)
Memory of past context
OUTPUT (oโ)
--
Formulas
hโ
= f(
U
ยทxโ +
W
ยทhโโโ + b)
Memory
oโ
= g(
V
ยทhโ + c)
Prediction