Using graphics processors for high-performance IR query processing

Shuai Ding, Jinru He, Hao Yan, Torsten Suel

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Web search engines are facing formidable performance challenges as they need to process thousands of queries per second over billions of documents. To deal with this heavy workload, current engines use massively parallel architectures of thousands of machines that require large hardware investments. We investigate new ways to build such high-performance IR systems based on Graphical Processing Units (GPUs). GPUs were originally designed to accelerate computer graphics applications through massive on-chip parallelism. Recently a number of researchers have studied how to use GPUs for other problem domains including databases and scientific computing [2, 3, 5], but we are not aware of previous attempts to use GPUs for large-scale web search. Our contribution here is to design a basic system architecture for GPU-based high-performance IR, and to describe how to perform highly efficient query processing within such an architecture. Preliminary experimental results based on a prototype implementation suggest that significant gains in query processing performance might be obtainable with such an approach.

    Original languageEnglish (US)
    Title of host publicationProceeding of the 17th International Conference on World Wide Web 2008, WWW'08
    Pages1213-1214
    Number of pages2
    DOIs
    StatePublished - 2008
    Event17th International Conference on World Wide Web 2008, WWW'08 - Beijing, China
    Duration: Apr 21 2008Apr 25 2008

    Other

    Other17th International Conference on World Wide Web 2008, WWW'08
    CountryChina
    CityBeijing
    Period4/21/084/25/08

    Fingerprint

    Query processing
    Processing
    Natural sciences computing
    Parallel architectures
    Computer graphics
    Search engines
    Engines
    Hardware

    Keywords

    • GPU
    • Query processing
    • Web search

    ASJC Scopus subject areas

    • Computer Networks and Communications

    Cite this

    Ding, S., He, J., Yan, H., & Suel, T. (2008). Using graphics processors for high-performance IR query processing. In Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08 (pp. 1213-1214) https://doi.org/10.1145/1367497.1367732

    Using graphics processors for high-performance IR query processing. / Ding, Shuai; He, Jinru; Yan, Hao; Suel, Torsten.

    Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08. 2008. p. 1213-1214.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Ding, S, He, J, Yan, H & Suel, T 2008, Using graphics processors for high-performance IR query processing. in Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08. pp. 1213-1214, 17th International Conference on World Wide Web 2008, WWW'08, Beijing, China, 4/21/08. https://doi.org/10.1145/1367497.1367732
    Ding S, He J, Yan H, Suel T. Using graphics processors for high-performance IR query processing. In Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08. 2008. p. 1213-1214 https://doi.org/10.1145/1367497.1367732
    Ding, Shuai ; He, Jinru ; Yan, Hao ; Suel, Torsten. / Using graphics processors for high-performance IR query processing. Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08. 2008. pp. 1213-1214
    @inproceedings{3573dd76153048b6b5651767fd214cb5,
    title = "Using graphics processors for high-performance IR query processing",
    abstract = "Web search engines are facing formidable performance challenges as they need to process thousands of queries per second over billions of documents. To deal with this heavy workload, current engines use massively parallel architectures of thousands of machines that require large hardware investments. We investigate new ways to build such high-performance IR systems based on Graphical Processing Units (GPUs). GPUs were originally designed to accelerate computer graphics applications through massive on-chip parallelism. Recently a number of researchers have studied how to use GPUs for other problem domains including databases and scientific computing [2, 3, 5], but we are not aware of previous attempts to use GPUs for large-scale web search. Our contribution here is to design a basic system architecture for GPU-based high-performance IR, and to describe how to perform highly efficient query processing within such an architecture. Preliminary experimental results based on a prototype implementation suggest that significant gains in query processing performance might be obtainable with such an approach.",
    keywords = "GPU, Query processing, Web search",
    author = "Shuai Ding and Jinru He and Hao Yan and Torsten Suel",
    year = "2008",
    doi = "10.1145/1367497.1367732",
    language = "English (US)",
    isbn = "9781605580852",
    pages = "1213--1214",
    booktitle = "Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08",

    }

    TY - GEN

    T1 - Using graphics processors for high-performance IR query processing

    AU - Ding, Shuai

    AU - He, Jinru

    AU - Yan, Hao

    AU - Suel, Torsten

    PY - 2008

    Y1 - 2008

    N2 - Web search engines are facing formidable performance challenges as they need to process thousands of queries per second over billions of documents. To deal with this heavy workload, current engines use massively parallel architectures of thousands of machines that require large hardware investments. We investigate new ways to build such high-performance IR systems based on Graphical Processing Units (GPUs). GPUs were originally designed to accelerate computer graphics applications through massive on-chip parallelism. Recently a number of researchers have studied how to use GPUs for other problem domains including databases and scientific computing [2, 3, 5], but we are not aware of previous attempts to use GPUs for large-scale web search. Our contribution here is to design a basic system architecture for GPU-based high-performance IR, and to describe how to perform highly efficient query processing within such an architecture. Preliminary experimental results based on a prototype implementation suggest that significant gains in query processing performance might be obtainable with such an approach.

    AB - Web search engines are facing formidable performance challenges as they need to process thousands of queries per second over billions of documents. To deal with this heavy workload, current engines use massively parallel architectures of thousands of machines that require large hardware investments. We investigate new ways to build such high-performance IR systems based on Graphical Processing Units (GPUs). GPUs were originally designed to accelerate computer graphics applications through massive on-chip parallelism. Recently a number of researchers have studied how to use GPUs for other problem domains including databases and scientific computing [2, 3, 5], but we are not aware of previous attempts to use GPUs for large-scale web search. Our contribution here is to design a basic system architecture for GPU-based high-performance IR, and to describe how to perform highly efficient query processing within such an architecture. Preliminary experimental results based on a prototype implementation suggest that significant gains in query processing performance might be obtainable with such an approach.

    KW - GPU

    KW - Query processing

    KW - Web search

    UR - http://www.scopus.com/inward/record.url?scp=57349191641&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=57349191641&partnerID=8YFLogxK

    U2 - 10.1145/1367497.1367732

    DO - 10.1145/1367497.1367732

    M3 - Conference contribution

    SN - 9781605580852

    SP - 1213

    EP - 1214

    BT - Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08

    ER -