The Neural Autoregressive Distribution Estimator The Neural Autoregressive Distribution Estimator
Paper summary #### Problem addressed: Density estimation #### Summary: This paper presented a tractable density estimator inspired from RBM. The inspiration comes from the procedure of using mean field approximation for the actual RBM probablities. It turns out that one step of the mean field approximation just corresponds to a one-hidden layer feed forward nerual networks with tied weights. #### Novelty: Find the link between the one step mean field approximation on RBM to a one layer neural network, and come up with a tractable density estimator that performs well. #### Drawbacks: There still a need to pre-select an ordering of variables before running the algorithm. #### Datasets: MNIST, binary observation datasets from Larochelle 2010 #### Additional remarks: The KL divergence minimization derivation is quite tricky (eq 7, 8) #### Resources: #### Presenter: Yingbo Zhou
www.jmlr.org
scholar.google.com
The Neural Autoregressive Distribution Estimator
Larochelle, Hugo and Murray, Iain
Journal of Machine Learning Research - 2011 via Local Bibsonomy
Keywords: dblp


Loading...
Your comment:


ShortScience.org allows researchers to publish paper summaries that are voted on and ranked!
About