Parsing Natural Scenes and Natural Language with Recursive Neural Networks Parsing Natural Scenes and Natural Language with Recursive Neural Networks
Paper summary #### Problem addressed: Learning recursive structure from natural data - sentences and images #### Summary: This paper introduces recursive neural networks in order to learn recursive structure in data. This recursive structure is illustrated by using examples of scene understanding using superpixel labels and parsing of natural language sentences. The authors go on define a novel neural network architecture, an objective function based on max-margin estimation and provide methods for backpropagation to train this network. They then evaluate its performance for accuracy in pixel labelling on the Stanford background dataset as well as for parsing sentences of Wall Street Journal section of the Penn TreeBank database. They achieve state-of-the-art and near state-of-the-art results respectively. #### Novelty: Introduction of recursive neural networks, framing an objective function to learn a recursive tree structure from data State of the art results on scene understanding and pixel labels for Stanford background dataset #### Drawbacks: Computational analysis of method not provided Not many details about the backpropagation method. #### Datasets: Stanford background dataset, Penn TreeBank #### Additional remarks: The thesis of the first author, Chapter 3 was referred during presentation. This paper almost identical to that and the thesis provides slightly more details. #### Resources: paper: http://www-nlp.stanford.edu/pubs/SocherLinNgManning_ICML2011.pdf thesis: http://nlp.stanford.edu/~socherr/thesis.pdf #### Presenter: Bhargava U. Kota
scholar.google.com
Parsing Natural Scenes and Natural Language with Recursive Neural Networks
Socher, Richard and Lin, Cliff Chiung-Yu and Ng, Andrew Y. and Manning, Christopher D.
International Conference on Machine Learning - 2011 via Local Bibsonomy
Keywords: dblp


Loading...
Your comment:


ShortScience.org allows researchers to publish paper summaries that are voted on and ranked!
About