NeuFlow: A runtime reconfigurable dataflow processor for vision

Clément Farabet, Berin Martini, Benoit Corda, Polina Akselrod, Eugenio Culurciello, Yann LeCun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we present a scalable dataflow hardware architecture optimized for the computation of general-purpose vision algorithms neuFlow and a dataflow compiler luaFlow that transforms high-level flow-graph representations of these algorithms into machine code for neuFlow. This system was designed with the goal of providing real-time detection, categorization and localization of objects in complex scenes, while consuming 10 Watts when implemented on a Xilinx Virtex 6 FPGA platform, or about ten times less than a laptop computer, and producing speedups of up to 100 times in real-world applications. We present an application of the system on street scene analysis, segmenting 20 categories on 500 × 375 frames at 12 frames per second on our custom hardware neuFlow.

Original languageEnglish (US)
Title of host publication2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2011
DOIs
Publication statusPublished - 2011
Event2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2011 - Colorado Springs, CO, United States
Duration: Jun 20 2011Jun 25 2011

Other

Other2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2011
CountryUnited States
CityColorado Springs, CO
Period6/20/116/25/11

    Fingerprint

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Cite this

Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., & LeCun, Y. (2011). NeuFlow: A runtime reconfigurable dataflow processor for vision. In 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2011 [5981829] https://doi.org/10.1109/CVPRW.2011.5981829