Recurrent Highway Networks Recurrent Highway Networks
Paper summary multi layer RNN in which first layer is LSTM, following layers $l$ have $t$,$c$ gates that control whether the state of the layer is carried from previous state or transferred previous layer: $s_l^{[t]} = h_l^{[t]} \cdot t_l^{[t]} + s_{l-1}^{[t]} \cdot c _l^{[t]}$

Summary by Udibr 2 years ago
Your comment: allows researchers to publish paper summaries that are voted on and ranked!

Sponsored by: and