GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology

Rachel Mandelbaum, Barnaby Rowe, Robert Armstrong, Deborah Bard, Emmanuel Bertin, James Bosch, Dominique Boutigny, Frederic Courbin, William A. Dawson, Annamaria Donnarumma, Ian Fenech Conti, Raphaël Gavazzi, Marc Gentile, Mandeep S S Gill, David W. Hogg, Eric M. Huff, M. James Jee, Tomasz Kacprzak, Martin Kilbinger, Thibault Kuntzer & 23 others Dustin Lang, Wentao Luo, Marisa C. March, Philip J. Marshall, Joshua E. Meyers, Lance Miller, Hironao Miyatake, Reiko Nakajima, Fred Maurice Ngolé Mboula, Guldariya Nurbaeva, Yuki Okura, Stéphane Paulin-Henriksson, Jason Rhodes, Michael D. Schneider, Huanyuan Shan, Erin S. Sheldon, Melanie Simet, Jean Luc Starck, Florent Sureau, Malte Tewes, Kristian Zarb Adami, Jun Zhang, Joe Zuntz

    Research output: Contribution to journalArticle

    Abstract

    We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by ~1 per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the Sérsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

    Original languageEnglish (US)
    Pages (from-to)2963-3007
    Number of pages45
    JournalMonthly Notices of the Royal Astronomical Society
    Volume450
    Issue number3
    DOIs
    StatePublished - 2015

    Fingerprint

    systematic errors
    galaxies
    shear
    point spread functions
    ellipticity
    experiment
    testing method
    innovation
    tolerance
    dark energy
    calibration
    simulation
    energy
    method
    sensitivity
    estimates
    approximation
    test

    Keywords

    • Cosmology: observations
    • Gravitational lensing: weak
    • Methods: data analysis
    • Techniques: image processing

    ASJC Scopus subject areas

    • Space and Planetary Science
    • Astronomy and Astrophysics

    Cite this

    GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology. / Mandelbaum, Rachel; Rowe, Barnaby; Armstrong, Robert; Bard, Deborah; Bertin, Emmanuel; Bosch, James; Boutigny, Dominique; Courbin, Frederic; Dawson, William A.; Donnarumma, Annamaria; Conti, Ian Fenech; Gavazzi, Raphaël; Gentile, Marc; Gill, Mandeep S S; Hogg, David W.; Huff, Eric M.; James Jee, M.; Kacprzak, Tomasz; Kilbinger, Martin; Kuntzer, Thibault; Lang, Dustin; Luo, Wentao; March, Marisa C.; Marshall, Philip J.; Meyers, Joshua E.; Miller, Lance; Miyatake, Hironao; Nakajima, Reiko; Mboula, Fred Maurice Ngolé; Nurbaeva, Guldariya; Okura, Yuki; Paulin-Henriksson, Stéphane; Rhodes, Jason; Schneider, Michael D.; Shan, Huanyuan; Sheldon, Erin S.; Simet, Melanie; Starck, Jean Luc; Sureau, Florent; Tewes, Malte; Adami, Kristian Zarb; Zhang, Jun; Zuntz, Joe.

    In: Monthly Notices of the Royal Astronomical Society, Vol. 450, No. 3, 2015, p. 2963-3007.

    Research output: Contribution to journalArticle

    Mandelbaum, R, Rowe, B, Armstrong, R, Bard, D, Bertin, E, Bosch, J, Boutigny, D, Courbin, F, Dawson, WA, Donnarumma, A, Conti, IF, Gavazzi, R, Gentile, M, Gill, MSS, Hogg, DW, Huff, EM, James Jee, M, Kacprzak, T, Kilbinger, M, Kuntzer, T, Lang, D, Luo, W, March, MC, Marshall, PJ, Meyers, JE, Miller, L, Miyatake, H, Nakajima, R, Mboula, FMN, Nurbaeva, G, Okura, Y, Paulin-Henriksson, S, Rhodes, J, Schneider, MD, Shan, H, Sheldon, ES, Simet, M, Starck, JL, Sureau, F, Tewes, M, Adami, KZ, Zhang, J & Zuntz, J 2015, 'GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology', Monthly Notices of the Royal Astronomical Society, vol. 450, no. 3, pp. 2963-3007. https://doi.org/10.1093/mnras/stv781
    Mandelbaum, Rachel ; Rowe, Barnaby ; Armstrong, Robert ; Bard, Deborah ; Bertin, Emmanuel ; Bosch, James ; Boutigny, Dominique ; Courbin, Frederic ; Dawson, William A. ; Donnarumma, Annamaria ; Conti, Ian Fenech ; Gavazzi, Raphaël ; Gentile, Marc ; Gill, Mandeep S S ; Hogg, David W. ; Huff, Eric M. ; James Jee, M. ; Kacprzak, Tomasz ; Kilbinger, Martin ; Kuntzer, Thibault ; Lang, Dustin ; Luo, Wentao ; March, Marisa C. ; Marshall, Philip J. ; Meyers, Joshua E. ; Miller, Lance ; Miyatake, Hironao ; Nakajima, Reiko ; Mboula, Fred Maurice Ngolé ; Nurbaeva, Guldariya ; Okura, Yuki ; Paulin-Henriksson, Stéphane ; Rhodes, Jason ; Schneider, Michael D. ; Shan, Huanyuan ; Sheldon, Erin S. ; Simet, Melanie ; Starck, Jean Luc ; Sureau, Florent ; Tewes, Malte ; Adami, Kristian Zarb ; Zhang, Jun ; Zuntz, Joe. / GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology. In: Monthly Notices of the Royal Astronomical Society. 2015 ; Vol. 450, No. 3. pp. 2963-3007.
    @article{b049dae7241841df85883fc1b4f2f670,
    title = "GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology",
    abstract = "We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by ~1 per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the S{\'e}rsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.",
    keywords = "Cosmology: observations, Gravitational lensing: weak, Methods: data analysis, Techniques: image processing",
    author = "Rachel Mandelbaum and Barnaby Rowe and Robert Armstrong and Deborah Bard and Emmanuel Bertin and James Bosch and Dominique Boutigny and Frederic Courbin and Dawson, {William A.} and Annamaria Donnarumma and Conti, {Ian Fenech} and Rapha{\"e}l Gavazzi and Marc Gentile and Gill, {Mandeep S S} and Hogg, {David W.} and Huff, {Eric M.} and {James Jee}, M. and Tomasz Kacprzak and Martin Kilbinger and Thibault Kuntzer and Dustin Lang and Wentao Luo and March, {Marisa C.} and Marshall, {Philip J.} and Meyers, {Joshua E.} and Lance Miller and Hironao Miyatake and Reiko Nakajima and Mboula, {Fred Maurice Ngol{\'e}} and Guldariya Nurbaeva and Yuki Okura and St{\'e}phane Paulin-Henriksson and Jason Rhodes and Schneider, {Michael D.} and Huanyuan Shan and Sheldon, {Erin S.} and Melanie Simet and Starck, {Jean Luc} and Florent Sureau and Malte Tewes and Adami, {Kristian Zarb} and Jun Zhang and Joe Zuntz",
    year = "2015",
    doi = "10.1093/mnras/stv781",
    language = "English (US)",
    volume = "450",
    pages = "2963--3007",
    journal = "Monthly Notices of the Royal Astronomical Society",
    issn = "0035-8711",
    publisher = "Oxford University Press",
    number = "3",

    }

    TY - JOUR

    T1 - GREAT3 results - I. Systematic errors in shear estimation and the impact of real galaxy morphology

    AU - Mandelbaum, Rachel

    AU - Rowe, Barnaby

    AU - Armstrong, Robert

    AU - Bard, Deborah

    AU - Bertin, Emmanuel

    AU - Bosch, James

    AU - Boutigny, Dominique

    AU - Courbin, Frederic

    AU - Dawson, William A.

    AU - Donnarumma, Annamaria

    AU - Conti, Ian Fenech

    AU - Gavazzi, Raphaël

    AU - Gentile, Marc

    AU - Gill, Mandeep S S

    AU - Hogg, David W.

    AU - Huff, Eric M.

    AU - James Jee, M.

    AU - Kacprzak, Tomasz

    AU - Kilbinger, Martin

    AU - Kuntzer, Thibault

    AU - Lang, Dustin

    AU - Luo, Wentao

    AU - March, Marisa C.

    AU - Marshall, Philip J.

    AU - Meyers, Joshua E.

    AU - Miller, Lance

    AU - Miyatake, Hironao

    AU - Nakajima, Reiko

    AU - Mboula, Fred Maurice Ngolé

    AU - Nurbaeva, Guldariya

    AU - Okura, Yuki

    AU - Paulin-Henriksson, Stéphane

    AU - Rhodes, Jason

    AU - Schneider, Michael D.

    AU - Shan, Huanyuan

    AU - Sheldon, Erin S.

    AU - Simet, Melanie

    AU - Starck, Jean Luc

    AU - Sureau, Florent

    AU - Tewes, Malte

    AU - Adami, Kristian Zarb

    AU - Zhang, Jun

    AU - Zuntz, Joe

    PY - 2015

    Y1 - 2015

    N2 - We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by ~1 per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the Sérsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

    AB - We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by ~1 per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the Sérsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

    KW - Cosmology: observations

    KW - Gravitational lensing: weak

    KW - Methods: data analysis

    KW - Techniques: image processing

    UR - http://www.scopus.com/inward/record.url?scp=84930853018&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84930853018&partnerID=8YFLogxK

    U2 - 10.1093/mnras/stv781

    DO - 10.1093/mnras/stv781

    M3 - Article

    VL - 450

    SP - 2963

    EP - 3007

    JO - Monthly Notices of the Royal Astronomical Society

    JF - Monthly Notices of the Royal Astronomical Society

    SN - 0035-8711

    IS - 3

    ER -