No photo of Robert Fergus

Robert Fergus

Associate Professor of Computer Science

    20012019
    If you made any changes in Pure, your changes will be visible here soon.

    Research Output 2001 2019

    2019

    Hierarchical RL using an ensemble of proprioceptive periodic policies

    Marino, K., Gupta, A., Szlam, A. & Fergus, R., Jan 1 2019.

    Research output: Contribution to conferencePaper

    reward
    Navigation
    Ensemble
    Reward
    Values
    2018

    Composable planning with attributes

    Zhang, A., Lerer, A., Sukhbaatar, S., Fergus, R. & Szlam, A., Jan 1 2018, 35th International Conference on Machine Learning, ICML 2018. Krause, A. & Dy, J. (eds.). International Machine Learning Society (IMLS), Vol. 13. p. 9292-9307 16 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Planning

    Intrinsic motivation and automatic curricula via asymmetric self-play

    Sukhbaatar, S., Lin, Z., Kostrikov, I., Synnaeve, G., Szlam, A. & Fergus, R., Jan 1 2018.

    Research output: Contribution to conferencePaper

    intrinsic motivation
    Curricula
    curriculum
    reward
    Curriculum

    Learning by Asking Questions

    Misra, I., Girshick, R., Fergus, R., Hebert, M., Gupta, A. & Van Der Maaten, L., Dec 14 2018, Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018. IEEE Computer Society, p. 11-20 10 p. 8578107. (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Curricula
    Learning systems
    Testing

    Modeling others using oneself in multi-agent reinforcement learning

    Raileanu, R., Denton, E., Szlam, A. & Fergus, R., Jan 1 2018, 35th International Conference on Machine Learning, ICML 2018. Krause, A. & Dy, J. (eds.). International Machine Learning Society (IMLS), Vol. 10. p. 6779-6788 10 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Reinforcement learning

    Stochastic Video Generation with a Learned Prior

    Denton, E. & Fergus, R., Jan 1 2018, 35th International Conference on Machine Learning, ICML 2018. Krause, A. & Dy, J. (eds.). International Machine Learning Society (IMLS), Vol. 3. p. 1906-1919 14 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2017

    Project 1640 Observations of Brown Dwarf GJ 758 B: Near-infrared Spectrum and Atmospheric Modeling

    Nilsson, R., Veicht, A., Godfrey, P. A. G., Rice, E. L., Aguilar, J., Pueyo, L., Roberts, L. C., Oppenheimer, R., Brenner, D., Luszcz-Cook, S. H., Bacchus, E., Beichman, C., Burruss, R., Cady, E., Dekany, R., Fergus, R., Hillenbrand, L., Hinkley, S., King, D., Lockhart, T. & 6 others, Parry, I. R., Sivaramakrishnan, A., Soummer, R., Vasisht, G., Zhai, C. & Zimmerman, N. T., Mar 20 2017, In : Astrophysical Journal. 838, 1, 64.

    Research output: Contribution to journalArticle

    atmospheric modeling
    near infrared
    infrared spectra
    stars
    sun
    2016

    Deep End2End Voxel2Voxel Prediction

    Tran, D., Bourdev, L., Fergus, R., Torresani, L. & Paluri, M., Dec 16 2016, Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016. IEEE Computer Society, p. 402-409 8 p. 7789547

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Optical flows
    Coloring
    Processing
    Labels
    Semantics

    Improving image classification with location context

    Tang, K., Paluri, M., Fei-Fei, L., Fergus, R. & Bourdev, L., Feb 17 2016, Proceedings - 2015 IEEE International Conference on Computer Vision, ICCV 2015. Institute of Electrical and Electronics Engineers Inc., Vol. 11-18-December-2015. p. 1008-1016 9 p. 7410478

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Image classification
    Global positioning system
    Availability
    Neural networks
    Image recognition

    Learning multiagent communication with backpropagation

    Sukhbaatar, S., Szlam, A. & Fergus, R., 2016, In : Advances in Neural Information Processing Systems. p. 2252-2260 9 p.

    Research output: Contribution to journalArticle

    Backpropagation
    Communication
    Network protocols

    Learning physical intuition of block towers by example

    Lerer, A., Gross, S. & Fergus, R., 2016, 33rd International Conference on Machine Learning, ICML 2016. International Machine Learning Society (IMLS), Vol. 1. p. 648-656 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Towers
    Physics
    Trajectories
    Engines

    Learning simple algorithms from examples

    Zaremba, W., Mikolov, T., Joulin, A. & Fergus, R., 2016, 33rd International Conference on Machine Learning, ICML 2016. International Machine Learning Society (IMLS), Vol. 1. p. 639-647 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Controllers
    Copying
    Tapes
    Neural networks

    Learning spatiotemporal features with 3D convolutional networks

    Tran, D., Bourdev, L., Fergus, R., Torresani, L. & Paluri, M., Feb 17 2016, Proceedings - 2015 IEEE International Conference on Computer Vision, ICCV 2015. Institute of Electrical and Electronics Engineers Inc., Vol. 11-18-December-2015. p. 4489-4497 9 p. 7410867

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Convolution
    Classifiers
    Deep learning

    Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture

    Eigen, D. & Fergus, R., Feb 17 2016, Proceedings - 2015 IEEE International Conference on Computer Vision, ICCV 2015. Institute of Electrical and Electronics Engineers Inc., Vol. 11-18-December-2015. p. 2650-2658 9 p. 7410661

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Labels
    Semantics
    Labeling
    Computer vision
    2015

    Beyond frontal faces: Improving Person Recognition using multiple cues

    Zhang, N., Paluri, M., Taigman, Y., Fergus, R. & Bourdev, L., Oct 14 2015, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, Vol. 07-12-June-2015. p. 4804-4813 10 p. 7299113

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Image resolution
    Lighting
    Cameras
    Experiments

    Deep generative image models using a laplacian pyramid of adversarial networks

    Denton, E., Chintala, S., Szlam, A. & Fergus, R., 2015, Advances in Neural Information Processing Systems. Neural information processing systems foundation, Vol. 2015-January. p. 1486-1494 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Image resolution

    Detection of third and sixth cranial nerve palsies with a novel method for eye tracking while watching a short film clip

    Samadani, U., Farooq, S., Ritlop, R., Warren, F., Reyes, M., Lamm, E., Alex, A., Nehrbass, E., Kolecki, R., Jureller, M., Schneider, J., Chen, A., Shi, C., Mendhiratta, N., Huang, J. H., Qian, M., Kwak, R., Mikheev, A., Rusinek, H., George, A. & 4 others, Fergus, R., Kondziolka, D., Huang, P. P. & Smith, R. T., Mar 1 2015, In : Journal of Neurosurgery. 122, 3, p. 707-720 14 p.

    Research output: Contribution to journalArticle

    Abducens Nerve Diseases
    Oculomotor Nerve
    Motion Pictures
    Surgical Instruments
    Cranial Nerve Diseases

    End-to-end integration of a Convolutional Network, Deformable Parts Model and non-maximum suppression

    Wan, L., Eigen, D. & Fergus, R., Oct 14 2015, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, Vol. 07-12-June-2015. p. 851-859 9 p. 7298686

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Volatile organic compounds
    Pixels
    Processing
    Chemical analysis
    Object detection

    End-to-end memory networks

    Sukhbaatar, S., Szlam, A., Weston, J. & Fergus, R., 2015, Advances in Neural Information Processing Systems. Neural information processing systems foundation, Vol. 2015-January. p. 2440-2448 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Data storage equipment
    Neural networks

    Training convolutional networks with noisy labels

    Sukhbaatar, S., Bruna Estrach, J., Paluri, M., Bourdev, L. & Fergus, R., Jan 1 2015.

    Research output: Contribution to conferencePaper

    Labels
    Availability
    infrastructure
    experiment
    Experiments

    User conditional hashtag prediction for images

    Denton, E., Weston, J., Paluri, M., Bourdev, L. & Fergus, R., Aug 10 2015, KDD 2015 - Proceedings of the 21st ACM SIGKDD Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery, Vol. 2015-August. p. 1731-1740 10 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Metadata
    Image classification
    Learning systems
    Labels
    Pixels

    Web scale photo hash clustering on a single machine

    Gong, Y., Pawlowski, M., Yang, F., Brandy, L., Boundev, L. & Fergus, R., Oct 14 2015, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, Vol. 07-12-June-2015. p. 19-27 9 p. 7298596

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Websites
    2014

    Depth map prediction from a single image using a multi-scale deep network

    Eigen, D., Puhrsch, C. & Fergus, R., 2014, Advances in Neural Information Processing Systems. January ed. Neural information processing systems foundation, Vol. 3. p. 2366-2374 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Geometry
    Uncertainty

    Exploiting linear structure within convolutional networks for efficient evaluation

    Denton, E., Zaremba, W., Bruna, J., LeCun, Y. & Fergus, R., 2014, Advances in Neural Information Processing Systems. January ed. Neural information processing systems foundation, Vol. 2. p. 1269-1277 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Smartphones
    Object recognition
    Convolution
    Program processors
    Redundancy

    Instance segmentation of indoor scenes using a coverage loss

    Silberman, N., Sontag, D. & Fergus, R., 2014, Computer Vision, ECCV 2014 - 13th European Conference, Proceedings. PART 1 ed. Springer Verlag, Vol. 8689 LNCS. p. 616-631 16 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 8689 LNCS, no. PART 1).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Coverage
    Segmentation
    Semantics
    Pixel
    Pixels

    Intriguing properties of neural networks

    Szegedy, C., Zaremba, W., Sutskever, I., Bruna Estrach, J., Erhan, D., Goodfellow, I. & Fergus, R., Jan 1 2014.

    Research output: Contribution to conferencePaper

    neural network
    Neural networks
    cause
    Semantics
    artifact

    Learning to discover efficient mathematical identities

    Zaremba, W., Kurach, K. & Fergus, R., 2014, Advances in Neural Information Processing Systems. January ed. Neural information processing systems foundation, Vol. 2. p. 1278-1286 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Learning systems
    Computational complexity
    Neural networks
    Chemical analysis

    Overfeat: Integrated recognition, localization and detection using convolutional networks

    Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R. & LeCun, Y., Jan 1 2014.

    Research output: Contribution to conferencePaper

    learning
    confidence
    Localization
    Deep learning
    Boundary Objects

    Overfeat: Integrated recognition, localization and detection using convolutional networks

    Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R. & Lecun, Y., 2014, International Conference on Learning Representations (ICLR2014), CBLS, April 2014. http://openreview.net/document/d332e77d-459a-4af8-b3ed-55ba, http://arxiv.org/abs/1312.6229

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    S4: A spatial-spectral model for speckle suppression

    Fergus, R., Hogg, D. W., Oppenheimer, R., Brenner, D. & Pueyo, L., Oct 20 2014, In : Astrophysical Journal. 794, 2, 161.

    Research output: Contribution to journalArticle

    speckle
    retarding
    brightness
    stars
    error signals
    learning
    activation
    Chemical activation
    Layer

    Visualizing and understanding convolutional networks

    Zeiler, M. D. & Fergus, R., 2014, Computer Vision, ECCV 2014 - 13th European Conference, Proceedings. PART 1 ed. Springer Verlag, Vol. 8689 LNCS. p. 818-833 16 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 8689 LNCS, no. PART 1).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Visualization
    Classifier
    Benchmark
    Classifiers
    Ablation
    2013

    Learning binary hash codes for large-scale image search

    Grauman, K. & Fergus, R., 2013, Machine Learning for Computer Vision. Vol. 411. p. 49-87 39 p. (Studies in Computational Intelligence; vol. 411).

    Research output: Chapter in Book/Report/Conference proceedingChapter

    Binary codes
    Content based retrieval
    Object recognition
    Spectrum analysis
    Data structures

    Reconnaissance of the hr 8799 exosolar system. I. near-infrared spectroscopy

    Roberts, L. C., Oppenheimer, B. R., Baranec, C., Beichman, C., Brenner, D., Burruss, R., Cady, E., Crepp, J. R., Dekany, R., Fergus, R., Hale, D., Hillenbrand, L., Hinkley, S., Hogg, D. W., King, D., Ligon, E. R., Lockhart, T., Nilsson, R., Parry, I. R., Pueyo, L. & 13 others, Rice, E., Roberts, J. E., Roberts, L. C., Shao, M., Sivaramakrishnan, A., Soummer, R., Truong, T., Vasisht, G., Veicht, A., Vescelus, F., Wallace, J. K., Zhai, C. & Zimmerman, N., May 1 2013, In : Astrophysical Journal. 768, 1, 24.

    Research output: Contribution to journalArticle

    reconnaissance
    infrared spectroscopy
    planets
    near infrared
    planet

    Regularization of neural networks using DropConnect

    Wan, L., Zeiler, M., Zhang, S., LeCun, Y. & Fergus, R., 2013, 30th International Conference on Machine Learning, ICML 2013. PART 3 ed. International Machine Learning Society (IMLS), p. 2095-2103 9 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Image recognition
    drop-out
    neural network
    Chemical activation
    Neural networks

    Restoring an image taken through a window covered with dirt or rain

    Eigen, D., Krishnan, D. & Fergus, R., 2013, Proceedings - 2013 IEEE International Conference on Computer Vision, ICCV 2013. Institute of Electrical and Electronics Engineers Inc., p. 633-640 8 p. 6751188

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Rain
    Cameras
    Enclosures
    Image processing
    Neural networks

    Stochastic pooling for regularization of deep convolutional neural networks

    Zeiler, M. D. & Fergus, R., Jan 1 2013.

    Research output: Contribution to conferencePaper

    neural network
    Chemical activation
    Neural networks
    drop-out
    activation

    Stochastic pooling for regularization of deep convolutional neural networks

    Zeiler, M. & Fergus, R., 2013, Proceedings of the International Conference on Learning Representation (ICLR).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2012

    A hybrid neural network-latent topic model

    Wan, L., Zhu, L. & Fergus, R., 2012, In : Journal of Machine Learning Research. 22, p. 1287-1294 8 p.

    Research output: Contribution to journalArticle

    Neural Networks
    Neural networks
    Hybrid Model
    Discriminative Training
    Model

    A hybrid neural-network latent topic model

    Wan, L., Zhu, L. & Fergus, R., 2012, Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Indoor segmentation and support inference from RGBD images

    Silberman, N., Hoiem, D., Kohli, P. & Fergus, R., 2012, Computer Vision, ECCV 2012 - 12th European Conference on Computer Vision, Proceedings. PART 5 ed. Vol. 7576 LNCS. p. 746-760 15 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 7576 LNCS, no. PART 5).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Segmentation
    Integer programming
    Integer Programming
    Annotation
    Verify

    Multidimensional spectral hashing

    Weiss, Y., Fergus, R. & Torralba, A., 2012, Computer Vision, ECCV 2012 - 12th European Conference on Computer Vision, Proceedings. PART 5 ed. Vol. 7576 LNCS. p. 340-353 14 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 7576 LNCS, no. PART 5).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Hashing
    Eigenvalues and eigenfunctions
    Binary codes
    Affine transformation
    Binary Code

    Nonparametric image parsing using adaptive neighbor sets

    Eigen, D. & Fergus, R., 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012. p. 2799-2806 8 p. 6248004

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Pixels
    2011

    Adaptive deconvolutional networks for mid and high level feature learning

    Zeiler, M. D., Taylor, G. W. & Fergus, R., 2011, 2011 International Conference on Computer Vision, ICCV 2011. p. 2018-2025 8 p. 6126474

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Classifiers
    Decomposition

    Blind deconvolution using a normalized sparsity measure

    Krishnan, D., Tay, T. & Fergus, R., 2011, 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011. p. 233-240 8 p. 5995521

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Deconvolution
    Cost functions
    Costs

    Facial expression transfer with input-output Temporal Restricted Boltzmann Machines

    Zeiler, M. D., Taylor, G. W., Sigal, L., Matthews, I. & Fergus, R., 2011, Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Probability distributions

    Indoor scene segmentation using a structured light sensor

    Silberman, N. & Fergus, R., 2011, 2011 IEEE International Conference on Computer Vision Workshops, ICCV Workshops 2011. p. 601-608 8 p. 6130298

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Sensors
    Labels

    Learning binary projections for large scale image search

    Grauman, K. & Fergus, R., 2011, Computer vision. Cipolla, R., Battiato, S. & Farinella, G. (eds.). Springer

    Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)

    Learning invariance through imitation

    Taylor, G. W., Spiro, I., Bregler, C. & Fergus, R., 2011, 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011. p. 2729-2736 8 p. 5995538

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Invariance
    Labels
    Lighting