Learning simple algorithms from examples

Wojciech Zaremba, Tomas Mikolov, Armand Joulin, Robert Fergus

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present an approach for learning simple algorithms such as copying, multi-digit addition and single digit multiplication directly from examples. Our framework consists of a set of interfaces, accessed by a controller. Typical interfaces are 1-D tapes or 2-D grids that hold the input and output data. For the controller, we explore a range of neural network-based models which vary in their ability to abstract the underlying algorithm from training instances and generalize to test examples with many thousands of digits. The controller is trained using Q-learning with several enhancements and we show that the bottleneck is in the capabilities of the controller rather than in the search incurred by Q-learning.

Original languageEnglish (US)
Title of host publication33rd International Conference on Machine Learning, ICML 2016
PublisherInternational Machine Learning Society (IMLS)
Pages639-647
Number of pages9
Volume1
ISBN (Electronic)9781510829008
StatePublished - 2016
Event33rd International Conference on Machine Learning, ICML 2016 - New York City, United States
Duration: Jun 19 2016Jun 24 2016

Other

Other33rd International Conference on Machine Learning, ICML 2016
CountryUnited States
CityNew York City
Period6/19/166/24/16

Fingerprint

Controllers
Copying
Tapes
Neural networks

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software
  • Computer Networks and Communications

Cite this

Zaremba, W., Mikolov, T., Joulin, A., & Fergus, R. (2016). Learning simple algorithms from examples. In 33rd International Conference on Machine Learning, ICML 2016 (Vol. 1, pp. 639-647). International Machine Learning Society (IMLS).

Learning simple algorithms from examples. / Zaremba, Wojciech; Mikolov, Tomas; Joulin, Armand; Fergus, Robert.

33rd International Conference on Machine Learning, ICML 2016. Vol. 1 International Machine Learning Society (IMLS), 2016. p. 639-647.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zaremba, W, Mikolov, T, Joulin, A & Fergus, R 2016, Learning simple algorithms from examples. in 33rd International Conference on Machine Learning, ICML 2016. vol. 1, International Machine Learning Society (IMLS), pp. 639-647, 33rd International Conference on Machine Learning, ICML 2016, New York City, United States, 6/19/16.
Zaremba W, Mikolov T, Joulin A, Fergus R. Learning simple algorithms from examples. In 33rd International Conference on Machine Learning, ICML 2016. Vol. 1. International Machine Learning Society (IMLS). 2016. p. 639-647
Zaremba, Wojciech ; Mikolov, Tomas ; Joulin, Armand ; Fergus, Robert. / Learning simple algorithms from examples. 33rd International Conference on Machine Learning, ICML 2016. Vol. 1 International Machine Learning Society (IMLS), 2016. pp. 639-647
@inproceedings{2f5ddbe08ca64970bad0bd5606e7db3e,
title = "Learning simple algorithms from examples",
abstract = "We present an approach for learning simple algorithms such as copying, multi-digit addition and single digit multiplication directly from examples. Our framework consists of a set of interfaces, accessed by a controller. Typical interfaces are 1-D tapes or 2-D grids that hold the input and output data. For the controller, we explore a range of neural network-based models which vary in their ability to abstract the underlying algorithm from training instances and generalize to test examples with many thousands of digits. The controller is trained using Q-learning with several enhancements and we show that the bottleneck is in the capabilities of the controller rather than in the search incurred by Q-learning.",
author = "Wojciech Zaremba and Tomas Mikolov and Armand Joulin and Robert Fergus",
year = "2016",
language = "English (US)",
volume = "1",
pages = "639--647",
booktitle = "33rd International Conference on Machine Learning, ICML 2016",
publisher = "International Machine Learning Society (IMLS)",

}

TY - GEN

T1 - Learning simple algorithms from examples

AU - Zaremba, Wojciech

AU - Mikolov, Tomas

AU - Joulin, Armand

AU - Fergus, Robert

PY - 2016

Y1 - 2016

N2 - We present an approach for learning simple algorithms such as copying, multi-digit addition and single digit multiplication directly from examples. Our framework consists of a set of interfaces, accessed by a controller. Typical interfaces are 1-D tapes or 2-D grids that hold the input and output data. For the controller, we explore a range of neural network-based models which vary in their ability to abstract the underlying algorithm from training instances and generalize to test examples with many thousands of digits. The controller is trained using Q-learning with several enhancements and we show that the bottleneck is in the capabilities of the controller rather than in the search incurred by Q-learning.

AB - We present an approach for learning simple algorithms such as copying, multi-digit addition and single digit multiplication directly from examples. Our framework consists of a set of interfaces, accessed by a controller. Typical interfaces are 1-D tapes or 2-D grids that hold the input and output data. For the controller, we explore a range of neural network-based models which vary in their ability to abstract the underlying algorithm from training instances and generalize to test examples with many thousands of digits. The controller is trained using Q-learning with several enhancements and we show that the bottleneck is in the capabilities of the controller rather than in the search incurred by Q-learning.

UR - http://www.scopus.com/inward/record.url?scp=84997831765&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84997831765&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84997831765

VL - 1

SP - 639

EP - 647

BT - 33rd International Conference on Machine Learning, ICML 2016

PB - International Machine Learning Society (IMLS)

ER -