No photo of Robert Fergus

Robert Fergus

Associate Professor of Computer Science

20012019
If you made any changes in Pure, your changes will be visible here soon.

Research Output 2001 2019

2019

Hierarchical RL using an ensemble of proprioceptive periodic policies

Marino, K., Gupta, A., Szlam, A. & Fergus, R., Jan 1 2019.

Research output: Contribution to conferencePaper

reward
Navigation
Ensemble
Reward
Values
2018

Composable planning with attributes

Zhang, A., Lerer, A., Sukhbaatar, S., Fergus, R. & Szlam, A., Jan 1 2018, 35th International Conference on Machine Learning, ICML 2018. Krause, A. & Dy, J. (eds.). International Machine Learning Society (IMLS), Vol. 13. p. 9292-9307 16 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Planning

Intrinsic motivation and automatic curricula via asymmetric self-play

Sukhbaatar, S., Lin, Z., Kostrikov, I., Synnaeve, G., Szlam, A. & Fergus, R., Jan 1 2018.

Research output: Contribution to conferencePaper

intrinsic motivation
Curricula
curriculum
reward
Curriculum

Learning by Asking Questions

Misra, I., Girshick, R., Fergus, R., Hebert, M., Gupta, A. & Van Der Maaten, L., Dec 14 2018, Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018. IEEE Computer Society, p. 11-20 10 p. 8578107. (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Curricula
Learning systems
Testing

Modeling others using oneself in multi-agent reinforcement learning

Raileanu, R., Denton, E., Szlam, A. & Fergus, R., Jan 1 2018, 35th International Conference on Machine Learning, ICML 2018. Krause, A. & Dy, J. (eds.). International Machine Learning Society (IMLS), Vol. 10. p. 6779-6788 10 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Reinforcement learning

Stochastic Video Generation with a Learned Prior

Denton, E. & Fergus, R., Jan 1 2018, 35th International Conference on Machine Learning, ICML 2018. Krause, A. & Dy, J. (eds.). International Machine Learning Society (IMLS), Vol. 3. p. 1906-1919 14 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2017

Project 1640 Observations of Brown Dwarf GJ 758 B: Near-infrared Spectrum and Atmospheric Modeling

Nilsson, R., Veicht, A., Godfrey, P. A. G., Rice, E. L., Aguilar, J., Pueyo, L., Roberts, L. C., Oppenheimer, R., Brenner, D., Luszcz-Cook, S. H., Bacchus, E., Beichman, C., Burruss, R., Cady, E., Dekany, R., Fergus, R., Hillenbrand, L., Hinkley, S., King, D., Lockhart, T. & 6 others, Parry, I. R., Sivaramakrishnan, A., Soummer, R., Vasisht, G., Zhai, C. & Zimmerman, N. T., Mar 20 2017, In : Astrophysical Journal. 838, 1, 64.

Research output: Contribution to journalArticle

atmospheric modeling
near infrared
infrared spectra
stars
sun
2016

Deep End2End Voxel2Voxel Prediction

Tran, D., Bourdev, L., Fergus, R., Torresani, L. & Paluri, M., Dec 16 2016, Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016. IEEE Computer Society, p. 402-409 8 p. 7789547

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Optical flows
Coloring
Processing
Labels
Semantics

Improving image classification with location context

Tang, K., Paluri, M., Fei-Fei, L., Fergus, R. & Bourdev, L., Feb 17 2016, Proceedings - 2015 IEEE International Conference on Computer Vision, ICCV 2015. Institute of Electrical and Electronics Engineers Inc., Vol. 11-18-December-2015. p. 1008-1016 9 p. 7410478

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Image classification
Global positioning system
Availability
Neural networks
Image recognition

Learning multiagent communication with backpropagation

Sukhbaatar, S., Szlam, A. & Fergus, R., 2016, In : Advances in Neural Information Processing Systems. p. 2252-2260 9 p.

Research output: Contribution to journalArticle

Backpropagation
Communication
Network protocols

Learning physical intuition of block towers by example

Lerer, A., Gross, S. & Fergus, R., 2016, 33rd International Conference on Machine Learning, ICML 2016. International Machine Learning Society (IMLS), Vol. 1. p. 648-656 9 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Towers
Physics
Trajectories
Engines

Learning simple algorithms from examples

Zaremba, W., Mikolov, T., Joulin, A. & Fergus, R., 2016, 33rd International Conference on Machine Learning, ICML 2016. International Machine Learning Society (IMLS), Vol. 1. p. 639-647 9 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Controllers
Copying
Tapes
Neural networks

Learning spatiotemporal features with 3D convolutional networks

Tran, D., Bourdev, L., Fergus, R., Torresani, L. & Paluri, M., Feb 17 2016, Proceedings - 2015 IEEE International Conference on Computer Vision, ICCV 2015. Institute of Electrical and Electronics Engineers Inc., Vol. 11-18-December-2015. p. 4489-4497 9 p. 7410867

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Convolution
Classifiers
Deep learning

Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture

Eigen, D. & Fergus, R., Feb 17 2016, Proceedings - 2015 IEEE International Conference on Computer Vision, ICCV 2015. Institute of Electrical and Electronics Engineers Inc., Vol. 11-18-December-2015. p. 2650-2658 9 p. 7410661

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Labels
Semantics
Labeling
Computer vision
2015

Beyond frontal faces: Improving Person Recognition using multiple cues

Zhang, N., Paluri, M., Taigman, Y., Fergus, R. & Bourdev, L., Oct 14 2015, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, Vol. 07-12-June-2015. p. 4804-4813 10 p. 7299113

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Image resolution
Lighting
Cameras
Experiments

Deep generative image models using a laplacian pyramid of adversarial networks

Denton, E., Chintala, S., Szlam, A. & Fergus, R., 2015, Advances in Neural Information Processing Systems. Neural information processing systems foundation, Vol. 2015-January. p. 1486-1494 9 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Image resolution

Detection of third and sixth cranial nerve palsies with a novel method for eye tracking while watching a short film clip

Samadani, U., Farooq, S., Ritlop, R., Warren, F., Reyes, M., Lamm, E., Alex, A., Nehrbass, E., Kolecki, R., Jureller, M., Schneider, J., Chen, A., Shi, C., Mendhiratta, N., Huang, J. H., Qian, M., Kwak, R., Mikheev, A., Rusinek, H., George, A. & 4 others, Fergus, R., Kondziolka, D., Huang, P. P. & Smith, R. T., Mar 1 2015, In : Journal of Neurosurgery. 122, 3, p. 707-720 14 p.

Research output: Contribution to journalArticle

Abducens Nerve Diseases
Oculomotor Nerve
Motion Pictures
Surgical Instruments
Cranial Nerve Diseases

End-to-end integration of a Convolutional Network, Deformable Parts Model and non-maximum suppression

Wan, L., Eigen, D. & Fergus, R., Oct 14 2015, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, Vol. 07-12-June-2015. p. 851-859 9 p. 7298686

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Volatile organic compounds
Pixels
Processing
Chemical analysis
Object detection

End-to-end memory networks

Sukhbaatar, S., Szlam, A., Weston, J. & Fergus, R., 2015, Advances in Neural Information Processing Systems. Neural information processing systems foundation, Vol. 2015-January. p. 2440-2448 9 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Data storage equipment
Neural networks

Training convolutional networks with noisy labels

Sukhbaatar, S., Bruna Estrach, J., Paluri, M., Bourdev, L. & Fergus, R., Jan 1 2015.

Research output: Contribution to conferencePaper

Labels
Availability
infrastructure
experiment
Experiments

User conditional hashtag prediction for images

Denton, E., Weston, J., Paluri, M., Bourdev, L. & Fergus, R., Aug 10 2015, KDD 2015 - Proceedings of the 21st ACM SIGKDD Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery, Vol. 2015-August. p. 1731-1740 10 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Metadata
Image classification
Learning systems
Labels
Pixels

Web scale photo hash clustering on a single machine

Gong, Y., Pawlowski, M., Yang, F., Brandy, L., Boundev, L. & Fergus, R., Oct 14 2015, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, Vol. 07-12-June-2015. p. 19-27 9 p. 7298596

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Websites
2014

Depth map prediction from a single image using a multi-scale deep network

Eigen, D., Puhrsch, C. & Fergus, R., 2014, Advances in Neural Information Processing Systems. January ed. Neural information processing systems foundation, Vol. 3. p. 2366-2374 9 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Geometry
Uncertainty

Exploiting linear structure within convolutional networks for efficient evaluation

Denton, E., Zaremba, W., Bruna, J., LeCun, Y. & Fergus, R., 2014, Advances in Neural Information Processing Systems. January ed. Neural information processing systems foundation, Vol. 2. p. 1269-1277 9 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Smartphones
Object recognition
Convolution
Program processors
Redundancy

Instance segmentation of indoor scenes using a coverage loss

Silberman, N., Sontag, D. & Fergus, R., 2014, Computer Vision, ECCV 2014 - 13th European Conference, Proceedings. PART 1 ed. Springer Verlag, Vol. 8689 LNCS. p. 616-631 16 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 8689 LNCS, no. PART 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Coverage
Segmentation
Semantics
Pixel
Pixels

Intriguing properties of neural networks

Szegedy, C., Zaremba, W., Sutskever, I., Bruna Estrach, J., Erhan, D., Goodfellow, I. & Fergus, R., Jan 1 2014.

Research output: Contribution to conferencePaper

neural network
Neural networks
cause
Semantics
artifact

Learning to discover efficient mathematical identities

Zaremba, W., Kurach, K. & Fergus, R., 2014, Advances in Neural Information Processing Systems. January ed. Neural information processing systems foundation, Vol. 2. p. 1278-1286 9 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Learning systems
Computational complexity
Neural networks
Chemical analysis

Overfeat: Integrated recognition, localization and detection using convolutional networks

Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R. & LeCun, Y., Jan 1 2014.

Research output: Contribution to conferencePaper

learning
confidence
Localization
Deep learning
Boundary Objects

Overfeat: Integrated recognition, localization and detection using convolutional networks

Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R. & Lecun, Y., 2014, International Conference on Learning Representations (ICLR2014), CBLS, April 2014. http://openreview.net/document/d332e77d-459a-4af8-b3ed-55ba, http://arxiv.org/abs/1312.6229

Research output: Chapter in Book/Report/Conference proceedingConference contribution

S4: A spatial-spectral model for speckle suppression

Fergus, R., Hogg, D. W., Oppenheimer, R., Brenner, D. & Pueyo, L., Oct 20 2014, In : Astrophysical Journal. 794, 2, 161.

Research output: Contribution to journalArticle

speckle
retarding
brightness
stars
error signals
learning
activation
Chemical activation
Layer

Visualizing and understanding convolutional networks

Zeiler, M. D. & Fergus, R., 2014, Computer Vision, ECCV 2014 - 13th European Conference, Proceedings. PART 1 ed. Springer Verlag, Vol. 8689 LNCS. p. 818-833 16 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 8689 LNCS, no. PART 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Visualization
Classifier
Benchmark
Classifiers
Ablation
2013

Learning binary hash codes for large-scale image search

Grauman, K. & Fergus, R., 2013, Machine Learning for Computer Vision. Vol. 411. p. 49-87 39 p. (Studies in Computational Intelligence; vol. 411).

Research output: Chapter in Book/Report/Conference proceedingChapter

Binary codes
Content based retrieval
Object recognition
Spectrum analysis
Data structures

Reconnaissance of the hr 8799 exosolar system. I. near-infrared spectroscopy

Roberts, L. C., Oppenheimer, B. R., Baranec, C., Beichman, C., Brenner, D., Burruss, R., Cady, E., Crepp, J. R., Dekany, R., Fergus, R., Hale, D., Hillenbrand, L., Hinkley, S., Hogg, D. W., King, D., Ligon, E. R., Lockhart, T., Nilsson, R., Parry, I. R., Pueyo, L. & 13 others, Rice, E., Roberts, J. E., Roberts, L. C., Shao, M., Sivaramakrishnan, A., Soummer, R., Truong, T., Vasisht, G., Veicht, A., Vescelus, F., Wallace, J. K., Zhai, C. & Zimmerman, N., May 1 2013, In : Astrophysical Journal. 768, 1, 24.

Research output: Contribution to journalArticle

reconnaissance
infrared spectroscopy
planets
near infrared
planet

Regularization of neural networks using DropConnect

Wan, L., Zeiler, M., Zhang, S., LeCun, Y. & Fergus, R., 2013, 30th International Conference on Machine Learning, ICML 2013. PART 3 ed. International Machine Learning Society (IMLS), p. 2095-2103 9 p.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Image recognition
drop-out
neural network
Chemical activation
Neural networks

Restoring an image taken through a window covered with dirt or rain

Eigen, D., Krishnan, D. & Fergus, R., 2013, Proceedings - 2013 IEEE International Conference on Computer Vision, ICCV 2013. Institute of Electrical and Electronics Engineers Inc., p. 633-640 8 p. 6751188

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Rain
Cameras
Enclosures
Image processing
Neural networks

Stochastic pooling for regularization of deep convolutional neural networks

Zeiler, M. D. & Fergus, R., Jan 1 2013.

Research output: Contribution to conferencePaper

neural network
Chemical activation
Neural networks
drop-out
activation

Stochastic pooling for regularization of deep convolutional neural networks

Zeiler, M. & Fergus, R., 2013, Proceedings of the International Conference on Learning Representation (ICLR).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2012

A hybrid neural network-latent topic model

Wan, L., Zhu, L. & Fergus, R., 2012, In : Journal of Machine Learning Research. 22, p. 1287-1294 8 p.

Research output: Contribution to journalArticle

Neural Networks
Neural networks
Hybrid Model
Discriminative Training
Model

A hybrid neural-network latent topic model

Wan, L., Zhu, L. & Fergus, R., 2012, Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Indoor segmentation and support inference from RGBD images

Silberman, N., Hoiem, D., Kohli, P. & Fergus, R., 2012, Computer Vision, ECCV 2012 - 12th European Conference on Computer Vision, Proceedings. PART 5 ed. Vol. 7576 LNCS. p. 746-760 15 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 7576 LNCS, no. PART 5).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Segmentation
Integer programming
Integer Programming
Annotation
Verify

Multidimensional spectral hashing

Weiss, Y., Fergus, R. & Torralba, A., 2012, Computer Vision, ECCV 2012 - 12th European Conference on Computer Vision, Proceedings. PART 5 ed. Vol. 7576 LNCS. p. 340-353 14 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 7576 LNCS, no. PART 5).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hashing
Eigenvalues and eigenfunctions
Binary codes
Affine transformation
Binary Code

Nonparametric image parsing using adaptive neighbor sets

Eigen, D. & Fergus, R., 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012. p. 2799-2806 8 p. 6248004

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Pixels
2011

Adaptive deconvolutional networks for mid and high level feature learning

Zeiler, M. D., Taylor, G. W. & Fergus, R., 2011, 2011 International Conference on Computer Vision, ICCV 2011. p. 2018-2025 8 p. 6126474

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Classifiers
Decomposition

Blind deconvolution using a normalized sparsity measure

Krishnan, D., Tay, T. & Fergus, R., 2011, 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011. p. 233-240 8 p. 5995521

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Deconvolution
Cost functions
Costs

Facial expression transfer with input-output Temporal Restricted Boltzmann Machines

Zeiler, M. D., Taylor, G. W., Sigal, L., Matthews, I. & Fergus, R., 2011, Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Probability distributions

Indoor scene segmentation using a structured light sensor

Silberman, N. & Fergus, R., 2011, 2011 IEEE International Conference on Computer Vision Workshops, ICCV Workshops 2011. p. 601-608 8 p. 6130298

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sensors
Labels

Learning binary projections for large scale image search

Grauman, K. & Fergus, R., 2011, Computer vision. Cipolla, R., Battiato, S. & Farinella, G. (eds.). Springer

Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)

Learning invariance through imitation

Taylor, G. W., Spiro, I., Bregler, C. & Fergus, R., 2011, 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011. p. 2729-2736 8 p. 5995538

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Invariance
Labels
Lighting