Neural Architecture Search with Reinforcement Learning Neural Architecture Search with Reinforcement Learning
Paper summary _Objective:_ Design a network that will itself find the best architecture for a given task. _Dataset:_ [CIFAR10](https://www.cs.toronto.edu/%7Ekriz/cifar.html) and [PTB](https://catalog.ldc.upenn.edu/ldc99t42). ## Inner-workings: The meta-network (a RNN) generates a string specifying the child network parameters. Such a child network is then trained for 35-50 epochs and its accuracy is used as the reward to train the meta-network with Reinforcement Learning. The RNN first generates networks with few layers (6) then this number is increased as training progresses. ## Architecture: They develop one architecture for CNN where they predict each layers characteristic plus it's possible skip-connection: [![screen shot 2017-05-24 at 8 13 01 am](https://cloud.githubusercontent.com/assets/17261080/26389176/d807de42-4058-11e7-942a-8a129558e126.png)](https://cloud.githubusercontent.com/assets/17261080/26389176/d807de42-4058-11e7-942a-8a129558e126.png) And one specific for LTSM-style: [![screen shot 2017-05-24 at 8 13 26 am](https://cloud.githubusercontent.com/assets/17261080/26389190/e2bfd506-4058-11e7-9168-62abd040156e.png)](https://cloud.githubusercontent.com/assets/17261080/26389190/e2bfd506-4058-11e7-9168-62abd040156e.png) ## Distributed setting: Bellow is the distributed setting that they use with parameter servers connected to replicas (GPUs) that trained child networks. [![screen shot 2017-05-24 at 8 09 05 am](https://cloud.githubusercontent.com/assets/17261080/26389084/5e354456-4058-11e7-83a9-089cb2c115b7.png)](https://cloud.githubusercontent.com/assets/17261080/26389084/5e354456-4058-11e7-83a9-089cb2c115b7.png) ## Results: Overall they trained 12800 networks on 800 GPUs but they achieve state of the art results which not human intervention except the vocabulary selection (activation type, type of cells, etc). Next step, transfer learning from one task to another for the meta-network?
arxiv.org
arxiv-sanity.com
scholar.google.com
Neural Architecture Search with Reinforcement Learning
Barret Zoph and Quoc V. Le
arXiv e-Print archive - 2016 via Local arXiv
Keywords: cs.LG, cs.AI, cs.NE

more

Summary by abhigenie92 10 months ago
Loading...
Your comment:
Summary by Martin Thoma 1 year ago
Loading...
Your comment:
Summary by Léo Paillier 5 months ago
Loading...
Your comment:


ShortScience.org allows researchers to publish paper summaries that are voted on and ranked!
About

Sponsored by: and