Distributed analysis with PROOF in ATLAS collaboration

Y. Panitkin, D. Benjamin, G. Carillo Montoya, K. Cranmer, M. Ernst, W. Guan, H. Ito, T. Maeno, S. Majewski, B. Mellado, O. Rind, A. Shibata, F. Tarrade, T. Wenaus, N. Xu, S. Ye

    Research output: Contribution to journalArticle

    Abstract

    The Parallel ROOT Facility - PROOF is a distributed analysis system which allows to exploit inherent event level parallelism of high energy physics data. PROOF can be configured to work with centralized storage systems, but it is especially effective together with distributed local storage systems - like Xrootd, when data are distributed over computing nodes. It works efficiently on different types of hardware and scales well from a multi-core laptop to large computing farms. From that point of view it is well suited for both large central analysis facilities and Tier 3 type analysis farms. PROOF can be used in interactive or batch like regimes. The interactive regime allows the user to work with typically distributed data from the ROOT command prompt and get a real time feedback on analysis progress and intermediate results. We will discuss our experience with PROOF in the context of ATLAS Collaboration distributed analysis. In particular we will discuss PROOF performance in various analysis scenarios and in multi-user, multi-session environments. We will also describe PROOF integration with the ATLAS distributed data management system and prospects of running PROOF on geographically distributed analysis farms.

    Original languageEnglish (US)
    Article number072014
    JournalJournal of Physics: Conference Series
    Volume219
    Issue number1 PART 7
    DOIs
    StatePublished - 2010

    Fingerprint

    data management
    management systems
    systems analysis
    commands
    hardware
    physics
    energy

    ASJC Scopus subject areas

    • Physics and Astronomy(all)

    Cite this

    Panitkin, Y., Benjamin, D., Carillo Montoya, G., Cranmer, K., Ernst, M., Guan, W., ... Ye, S. (2010). Distributed analysis with PROOF in ATLAS collaboration. Journal of Physics: Conference Series, 219(1 PART 7), [072014]. https://doi.org/10.1088/1742-6596/219/7/072014

    Distributed analysis with PROOF in ATLAS collaboration. / Panitkin, Y.; Benjamin, D.; Carillo Montoya, G.; Cranmer, K.; Ernst, M.; Guan, W.; Ito, H.; Maeno, T.; Majewski, S.; Mellado, B.; Rind, O.; Shibata, A.; Tarrade, F.; Wenaus, T.; Xu, N.; Ye, S.

    In: Journal of Physics: Conference Series, Vol. 219, No. 1 PART 7, 072014, 2010.

    Research output: Contribution to journalArticle

    Panitkin, Y, Benjamin, D, Carillo Montoya, G, Cranmer, K, Ernst, M, Guan, W, Ito, H, Maeno, T, Majewski, S, Mellado, B, Rind, O, Shibata, A, Tarrade, F, Wenaus, T, Xu, N & Ye, S 2010, 'Distributed analysis with PROOF in ATLAS collaboration', Journal of Physics: Conference Series, vol. 219, no. 1 PART 7, 072014. https://doi.org/10.1088/1742-6596/219/7/072014
    Panitkin Y, Benjamin D, Carillo Montoya G, Cranmer K, Ernst M, Guan W et al. Distributed analysis with PROOF in ATLAS collaboration. Journal of Physics: Conference Series. 2010;219(1 PART 7). 072014. https://doi.org/10.1088/1742-6596/219/7/072014
    Panitkin, Y. ; Benjamin, D. ; Carillo Montoya, G. ; Cranmer, K. ; Ernst, M. ; Guan, W. ; Ito, H. ; Maeno, T. ; Majewski, S. ; Mellado, B. ; Rind, O. ; Shibata, A. ; Tarrade, F. ; Wenaus, T. ; Xu, N. ; Ye, S. / Distributed analysis with PROOF in ATLAS collaboration. In: Journal of Physics: Conference Series. 2010 ; Vol. 219, No. 1 PART 7.
    @article{515345162f184b6a8bb1f2af5bf5308f,
    title = "Distributed analysis with PROOF in ATLAS collaboration",
    abstract = "The Parallel ROOT Facility - PROOF is a distributed analysis system which allows to exploit inherent event level parallelism of high energy physics data. PROOF can be configured to work with centralized storage systems, but it is especially effective together with distributed local storage systems - like Xrootd, when data are distributed over computing nodes. It works efficiently on different types of hardware and scales well from a multi-core laptop to large computing farms. From that point of view it is well suited for both large central analysis facilities and Tier 3 type analysis farms. PROOF can be used in interactive or batch like regimes. The interactive regime allows the user to work with typically distributed data from the ROOT command prompt and get a real time feedback on analysis progress and intermediate results. We will discuss our experience with PROOF in the context of ATLAS Collaboration distributed analysis. In particular we will discuss PROOF performance in various analysis scenarios and in multi-user, multi-session environments. We will also describe PROOF integration with the ATLAS distributed data management system and prospects of running PROOF on geographically distributed analysis farms.",
    author = "Y. Panitkin and D. Benjamin and {Carillo Montoya}, G. and K. Cranmer and M. Ernst and W. Guan and H. Ito and T. Maeno and S. Majewski and B. Mellado and O. Rind and A. Shibata and F. Tarrade and T. Wenaus and N. Xu and S. Ye",
    year = "2010",
    doi = "10.1088/1742-6596/219/7/072014",
    language = "English (US)",
    volume = "219",
    journal = "Journal of Physics: Conference Series",
    issn = "1742-6588",
    publisher = "IOP Publishing Ltd.",
    number = "1 PART 7",

    }

    TY - JOUR

    T1 - Distributed analysis with PROOF in ATLAS collaboration

    AU - Panitkin, Y.

    AU - Benjamin, D.

    AU - Carillo Montoya, G.

    AU - Cranmer, K.

    AU - Ernst, M.

    AU - Guan, W.

    AU - Ito, H.

    AU - Maeno, T.

    AU - Majewski, S.

    AU - Mellado, B.

    AU - Rind, O.

    AU - Shibata, A.

    AU - Tarrade, F.

    AU - Wenaus, T.

    AU - Xu, N.

    AU - Ye, S.

    PY - 2010

    Y1 - 2010

    N2 - The Parallel ROOT Facility - PROOF is a distributed analysis system which allows to exploit inherent event level parallelism of high energy physics data. PROOF can be configured to work with centralized storage systems, but it is especially effective together with distributed local storage systems - like Xrootd, when data are distributed over computing nodes. It works efficiently on different types of hardware and scales well from a multi-core laptop to large computing farms. From that point of view it is well suited for both large central analysis facilities and Tier 3 type analysis farms. PROOF can be used in interactive or batch like regimes. The interactive regime allows the user to work with typically distributed data from the ROOT command prompt and get a real time feedback on analysis progress and intermediate results. We will discuss our experience with PROOF in the context of ATLAS Collaboration distributed analysis. In particular we will discuss PROOF performance in various analysis scenarios and in multi-user, multi-session environments. We will also describe PROOF integration with the ATLAS distributed data management system and prospects of running PROOF on geographically distributed analysis farms.

    AB - The Parallel ROOT Facility - PROOF is a distributed analysis system which allows to exploit inherent event level parallelism of high energy physics data. PROOF can be configured to work with centralized storage systems, but it is especially effective together with distributed local storage systems - like Xrootd, when data are distributed over computing nodes. It works efficiently on different types of hardware and scales well from a multi-core laptop to large computing farms. From that point of view it is well suited for both large central analysis facilities and Tier 3 type analysis farms. PROOF can be used in interactive or batch like regimes. The interactive regime allows the user to work with typically distributed data from the ROOT command prompt and get a real time feedback on analysis progress and intermediate results. We will discuss our experience with PROOF in the context of ATLAS Collaboration distributed analysis. In particular we will discuss PROOF performance in various analysis scenarios and in multi-user, multi-session environments. We will also describe PROOF integration with the ATLAS distributed data management system and prospects of running PROOF on geographically distributed analysis farms.

    UR - http://www.scopus.com/inward/record.url?scp=77955387280&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=77955387280&partnerID=8YFLogxK

    U2 - 10.1088/1742-6596/219/7/072014

    DO - 10.1088/1742-6596/219/7/072014

    M3 - Article

    VL - 219

    JO - Journal of Physics: Conference Series

    JF - Journal of Physics: Conference Series

    SN - 1742-6588

    IS - 1 PART 7

    M1 - 072014

    ER -