Estimating or Propagating Gradients Through Stochastic Neurons Estimating or Propagating Gradients Through Stochastic Neurons
Paper summary #### Problem addressed: Gradient estimation for stochastic neurons #### Summary: This paper proposed an unbiased estimator of stochastic units so that one can use gradient based learning. In addition, it also proposed a simple, biased estimator called straight through. #### Novelty: A new approach for estimating gradient for stochastic units. #### Drawbacks: The proposed unbised estimator seems to have large variance, and the biased one seems not performing very well in practice #### Presenter: Yingbo Zhou
arxiv.org
arxiv-sanity.com
scholar.google.com
Estimating or Propagating Gradients Through Stochastic Neurons
Yoshua Bengio
arXiv e-Print archive - 2013 via Local arXiv
Keywords: cs.LG

more

Loading...
Your comment:


ShortScience.org allows researchers to publish paper summaries that are voted on and ranked!
About