Recurrent Highway Networks Recurrent Highway Networks
Paper summary multi layer RNN in which first layer is LSTM, following layers $l$ have $t$,$c$ gates that control whether the state of the layer is carried from previous state or transferred previous layer: $s_l^{[t]} = h_l^{[t]} \cdot t_l^{[t]} + s_{l-1}^{[t]} \cdot c _l^{[t]}$
Recurrent Highway Networks
Julian Georg Zilly and Rupesh Kumar Srivastava and Jan Koutník and Jürgen Schmidhuber
arXiv e-Print archive - 2016 via arXiv
Keywords: cs.LG, cs.CL, cs.NE


Your comment: allows researchers to publish paper summaries that are voted on and ranked!