Hybrid computing using a neural network with dynamic external memory Hybrid computing using a neural network with dynamic external memory
Paper summary The DeepMind guys present an extension to the Neural Turing Machine architecture. https://i.imgur.com/4TC6yAp.png They call it a Differentiable Neural Computer (DNC) and it uses 1) an attention mechanism to access information in a matrix that acts as a memory, 2) an attention mechanism to save information to that memory, and 3) a transition matrix that stores information about the order in which rows in the memory are modified, in order to better handle sequential information. They test on the bAbI question answering dataset, a graph inference task, and on solving a puzzle of arranging blocks.

Summary by MarvMind 1 year ago
Loading...
Your comment:
Summary by Marek Rei 8 months ago
Loading...
Your comment:


ShortScience.org allows researchers to publish paper summaries that are voted on and ranked!
About

Sponsored by: and