A

Euclid preparation

Astronomy and Astrophysics, vol. 708, pp. A167

Abstract

We develop techniques for generating accurate and precise internal covariances for measurements of clustering and weak-lensing angular power spectra. These methods have been designed to produce non-singular and unbiased covariances for Euclid ’s large anticipated data vector and will be critical for validation against observational systematic effects. We constructed jackknife segments that are equal in area to a high precision by adapting the binary space partition algorithm to work on arbitrarily shaped regions on the unit sphere. Jackknife estimates of the covariances are internally derived and require no assumptions about cosmology or galaxy population and bias. Our covariance estimation, called DICES (Debiased Internal Covariance Estimation with Shrinkage), first estimated a noisy covariance through conventional delete-1 jackknife resampling. This was followed by linear shrinkage of the empirical correlation matrix towards the Gaussian prediction, rather than linear shrinkage of the covariance matrix. Shrinkage ensures the covariance is non-singular and therefore invertible, which is critical for the estimation of likelihoods and validation. We then applied a delete-2 jackknife bias correction to the diagonal components of the jackknife covariance that removed the general tendency for jackknife error estimates to be biased high. We validated internally derived covariances, which used the jackknife resampling technique, on synthetic Euclid -like lognormal catalogues. We demonstrate that DICES produces accurate, non-singular covariance estimates, with the relative error improving by 33% for the covariance and 48% for the correlation structure in comparison to jackknife estimates. These estimates can be used for highly accurate regression and inference.

Authors 100

  1. University College London · University of Portsmouth

    Affiliation as printed

    Department of Physics and Astronomy, University College London

    Institute of Cosmology and Gravitation, University of Portsmouth

  2. University College London

    Affiliation as printed

    Department of Physics and Astronomy, University College London

  3. University College London

    Affiliation as printed

    Department of Physics and Astronomy, University College London

  4. University College London

    Affiliation as printed

    Department of Physics and Astronomy, University College London

  5. Stockholm University · Imperial College London

    Affiliation as printed

    Astrophysics Group, Blackett Laboratory, Imperial College London

    Oskar Klein Centre for Cosmoparticle Physics, Department of Physics, Stockholm University

  6. Centre National de la Recherche Scientifique · Université Paris-Saclay · Institut d'Astrophysique Spatiale

    Affiliation as printed

    Université Paris-Saclay, CNRS, Institut d’astrophysique spatiale

    IAS - Institut d'astrophysique spatiale (Bâtiment 121 91405 ORSAY CEDEX - France)

  7. European Space Agency · European Space Astronomy Centre

    Affiliation as printed

    ESAC/ESA

  8. University of Surrey

    Affiliation as printed

    School of Mathematics and Physics, University of Surrey

  9. Heidelberg University

    Affiliation as printed

    Institut für Theoretische Physik, University of Heidelberg

  10. Brera Astronomical Observatory · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Brera

  11. Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

  12. Scuola Internazionale Superiore di Studi Avanzati · Trieste Astronomical Observatory · Istituto Nazionale di Fisica Nucleare, Sezione di Trieste · Institute for Fundamental Physics of the Universe · National Institute for Astrophysics

    Affiliation as printed

    IFPU, Institute for Fundamental Physics of the Universe

    INAF-Osservatorio Astronomico di Trieste

    INFN, Sezione di Trieste

    SISSA, International School for Advanced Studies

  13. Centre National d'Études Spatiales

    Affiliation as printed

    Centre National d’Etudes Spatiales – Centre spatial de Toulouse

    CNES - Centre National d'Études Spatiales [Toulouse] (18 avenue Edouard Belin 31401 Toulouse - France)

  14. Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics · University of Bologna

    Affiliation as printed

    Dipartimento di Fisica e Astronomia, Università di Bologna

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

    INFN-Sezione di Bologna

  15. Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

  16. Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

  17. Trieste Astronomical Observatory · Institute for Fundamental Physics of the Universe · National Institute for Astrophysics

    Affiliation as printed

    IFPU, Institute for Fundamental Physics of the Universe

    INAF-Osservatorio Astronomico di Trieste

  18. Brera Astronomical Observatory · Istituto Nazionale di Fisica Nucleare, Sezione di Genova · University of Genoa · National Institute for Astrophysics

    Affiliation as printed

    Dipartimento di Fisica, Università di Genova

    INAF-Osservatorio Astronomico di Brera

    INFN-Sezione di Genova

  19. Astronomical Observatory of Capodimonte · University of Naples Federico II · National Institute for Astrophysics

    Affiliation as printed

    Department of Physics “E. Pancini”, University Federico II

    INAF-Osservatorio Astronomico di Capodimonte

  20. Istituto Nazionale di Fisica Nucleare, Sezione di Torino · Osservatorio Astrofisico di Torino · University of Turin · National Institute for Astrophysics

    Affiliation as printed

    Dipartimento di Fisica, Università degli Studi di Torino

    INAF-Osservatorio Astrofisico di Torino

    INFN-Sezione di Torino

  21. Osservatorio Astrofisico di Torino · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astrofisico di Torino

  22. National Institute for Astrophysics

    Affiliation as printed

    INAF-IASF Milano

  23. Astronomical Observatory of Rome · Istituto Nazionale di Fisica Nucleare, Sezione di Roma I · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Roma

    INFN-Sezione di Roma

  24. Port d'Informació Científica · Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas

    Affiliation as printed

    Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas (CIEMAT)

    Port d’Informació Científica

  25. Astronomical Observatory of Rome · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Roma

  26. Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

  27. Istituto Nazionale di Fisica Nucleare · Astronomical Observatory of Capodimonte · Istituto Nazionale di Fisica Nucleare, Sezione di Napoli · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Capodimonte

    INFN section of Naples

  28. University of Hawaiʻi at Mānoa · University of Hawaii System

    Affiliation as printed

    Institute for Astronomy, University of Hawaii

  29. University of Bologna

    Affiliation as printed

    Dipartimento di Fisica e Astronomia “Augusto Righi” – Alma Mater Studiorum Università di Bologna

  30. Instituto de Astrofísica de Canarias

    Affiliation as printed

    Instituto de Astrofísica de Canarias

  31. Royal Observatory · University of Edinburgh

    Affiliation as printed

    Institute for Astronomy, University of Edinburgh, Royal Observatory

  32. European Space Agency · European Space Astronomy Centre · European Space Research Institute

    Affiliation as printed

    ESAC/ESA

    European Space Agency/ESRIN

  33. Lyon 1 Université · Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Institut de Physique des 2 Infinis de Lyon

    Affiliation as printed

    Université Claude Bernard Lyon 1, CNRS/IN2P3, IP2I Lyon, UMR 5822

    IP2I Lyon - Institut de Physique des 2 Infinis de Lyon (Campus LyonTech-la Doua Bâtiment Paul DIRAC 4 Rue Enrico Fermi 69622 Villeurbanne Cedex - France)

  34. Institució Catalana de Recerca i Estudis Avançats · Institut de Ciències del Cosmos · Universitat de Barcelona

    Affiliation as printed

    Institució Catalana de Recerca i Estudis Avançats (ICREA)

    Institut de Ciències del Cosmos (ICCUB), Universitat de Barcelona (IEEC-UB)

  35. Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Institut de Physique des 2 Infinis de Lyon

    Affiliation as printed

    UCB Lyon 1, CNRS/IN2P3, IUF, IP2I Lyon

    IP2I Lyon - Institut de Physique des 2 Infinis de Lyon (Campus LyonTech-la Doua Bâtiment Paul DIRAC 4 Rue Enrico Fermi 69622 Villeurbanne Cedex - France)

  36. University of Lisbon · Institute of Astrophysics and Space Sciences

    Affiliation as printed

    Departamento de Física, Faculdade de Ciências, Universidade de Lisboa

    Instituto de Astrofísica e Ciências do Espaço, Faculdade de Ciências, Universidade de Lisboa

  37. University of Geneva

    Affiliation as printed

    Department of Astronomy, University of Geneva

  38. Trieste Astronomical Observatory · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Trieste

  39. University of Geneva

    Affiliation as printed

    Department of Astronomy, University of Geneva

  40. European Space Agency · European Space Astronomy Centre

    Affiliation as printed

    ESAC/ESA

  41. Istituto Nazionale di Fisica Nucleare · Istituto Nazionale di Fisica Nucleare, Sezione di Padova

    Affiliation as printed

    INFN-Padova

  42. Centre National de la Recherche Scientifique · Aix-Marseille Université · Centre de physique des particules de Marseille · Institut National de Physique Nucléaire et de Physique des Particules

    Affiliation as printed

    Aix-Marseille Université, CNRS/IN2P3, CPPM

    CPPM - Centre de Physique des Particules de Marseille (163, avenue de Luminy - Case 902 - 13288 Marseille cedex 09 - France)

  43. Institute for Space Astrophysics and Planetology · National Institute for Astrophysics

    Affiliation as printed

    INAF-Istituto di Astrofisica e Planetologia Spaziali

  44. Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

  45. Centre National de la Recherche Scientifique · Université Paris Cité · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · CEA Paris-Saclay - Etablissement de Saclay · Astrophysique, Instrumentation et Modélisation · CEA Paris-Saclay

    Affiliation as printed

    Université Paris-Saclay, Université Paris Cité, CEA, CNRS, AIM

    AIM (UMR_7158 / UMR_E_9005 / UM_112) - Astrophysique Interprétation Modélisation (AIM - UMR 7158 - UMR E 9005, ex 'Astrophysique Interactions Multi-échelles', Service d'astrophysique, CEA/Saclay, Orme des Merisiers F-91191 GIF SUR YVETTE CEDEX - France)

  46. Astronomical Observatory of Rome · Agenzia Spaziale Italiana · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Roma

    Space Science Data Center, Italian Space Agency

  47. Lyon 1 Université · Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Institut de Physique des 2 Infinis de Lyon

    Affiliation as printed

    Université Claude Bernard Lyon 1, CNRS/IN2P3, IP2I Lyon, UMR 5822

    IP2I Lyon - Institut de Physique des 2 Infinis de Lyon (Campus LyonTech-la Doua Bâtiment Paul DIRAC 4 Rue Enrico Fermi 69622 Villeurbanne Cedex - France)

  48. Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

    INFN-Bologna

  49. Institute of Space Sciences · Institut d'Estudis Espacials de Catalunya · Universitat Politècnica de Catalunya

    Affiliation as printed

    Institut d’Estudis Espacials de Catalunya (IEEC), Edifici RDIT, Campus UPC

    Institute of Space Sciences (ICE, CSIC), Campus UAB

  50. Trieste Astronomical Observatory · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Trieste

  51. Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

  52. National Institute for Astrophysics

    Affiliation as printed

    INAF-IASF Milano

  53. Trieste Astronomical Observatory · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Trieste

  54. Ludwig-Maximilians-Universität München

    Affiliation as printed

    Universitäts-Sternwarte München, Fakultät für Physik, Ludwig-Maximilians-Universität München

  55. Royal Observatory · University of Edinburgh

    Affiliation as printed

    Institute for Astronomy, University of Edinburgh, Royal Observatory

  56. Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

    INFN-Sezione di Bologna

  57. Max Planck Institute for Extraterrestrial Physics

    Affiliation as printed

    Max Planck Institute for Extraterrestrial Physics

  58. Osservatorio Astronomico di Padova · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Padova

  59. Max Planck Institute for Extraterrestrial Physics · Ludwig-Maximilians-Universität München

    Affiliation as printed

    Max Planck Institute for Extraterrestrial Physics

    Universitäts-Sternwarte München, Fakultät für Physik, Ludwig-Maximilians-Universität München

  60. Jet Propulsion Laboratory

    Affiliation as printed

    Jet Propulsion Laboratory, California Institute of Technology

  61. Affiliation as printed

    Felix Hormuth Engineering

  62. Technical University of Denmark

    Affiliation as printed

    Cosmic Dawn Center (DAWN)

    Technical University of Denmark

  63. Max Planck Institute for Astronomy

    Affiliation as printed

    Max-Planck-Institut für Astronomie

  64. Goddard Space Flight Center

    Affiliation as printed

    NASA Goddard Space Flight Center

  65. Helsinki Institute of Physics

    Affiliation as printed

    Department of Physics and Helsinki Institute of Physics

  66. Centre National de la Recherche Scientifique · Aix-Marseille Université · Centre de physique des particules de Marseille · Institut National de Physique Nucléaire et de Physique des Particules

    Affiliation as printed

    Aix-Marseille Université, CNRS/IN2P3, CPPM

    CPPM - Centre de Physique des Particules de Marseille (163, avenue de Luminy - Case 902 - 13288 Marseille cedex 09 - France)

  67. Jet Propulsion Laboratory

    Affiliation as printed

    Jet Propulsion Laboratory, California Institute of Technology

  68. Centre National de la Recherche Scientifique · Université Paris Cité · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · CEA Paris-Saclay - Etablissement de Saclay · Astrophysique, Instrumentation et Modélisation · CEA Paris-Saclay

    Affiliation as printed

    Université Paris-Saclay, Université Paris Cité, CEA, CNRS, AIM

    AIM (UMR_7158 / UMR_E_9005 / UM_112) - Astrophysique Interprétation Modélisation (AIM - UMR 7158 - UMR E 9005, ex 'Astrophysique Interactions Multi-échelles', Service d'astrophysique, CEA/Saclay, Orme des Merisiers F-91191 GIF SUR YVETTE CEDEX - France)

  69. Lyon 1 Université · Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Institut de Physique des 2 Infinis de Lyon

    Affiliation as printed

    Université Claude Bernard Lyon 1, CNRS/IN2P3, IP2I Lyon, UMR 5822

    IP2I Lyon - Institut de Physique des 2 Infinis de Lyon (Campus LyonTech-la Doua Bâtiment Paul DIRAC 4 Rue Enrico Fermi 69622 Villeurbanne Cedex - France)

  70. Ludwig-Maximilians-Universität München

    Affiliation as printed

    Universitäts-Sternwarte München, Fakultät für Physik, Ludwig-Maximilians-Universität München

  71. University of Geneva

    Affiliation as printed

    Université de Genève, Département de Physique Théorique and Centre for Astroparticle Physics

  72. Helsinki Institute of Physics

    Affiliation as printed

    Department of Physics

    Helsinki Institute of Physics

  73. Centre National de la Recherche Scientifique · Université Paris Sciences et Lettres · Observatoire de Paris · Sorbonne Université · Laboratoire d'Étude de l'Univers et des Phénomènes Extrêmes

    Affiliation as printed

    Laboratoire d’etude de l’Univers et des phenomenes eXtremes, Observatoire de Paris, Université PSL, Sorbonne Université, CNRS

  74. Osservatorio Astrofisico di Torino · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astrofisico di Torino

  75. University of Oslo

    Affiliation as printed

    Institute of Theoretical Astrophysics, University of Oslo

  76. Helsinki Institute of Physics

    Affiliation as printed

    Department of Physics

    Helsinki Institute of Physics

  77. SKA Observatory

    Affiliation as printed

    SKA Observatory

  78. Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Centre de Calcul de l’Institut National de Physique Nucléaire et de Physique des Particules

    Affiliation as printed

    Centre de Calcul de l’IN2P3/CNRS

    CC-IN2P3 - Centre de Calcul de l'IN2P3 (Domaine scientifique de La Doua 43 bd du 11 Novembre 1918 69622 Villeurbanne Cedex - France)

  79. University of Milan · Istituto Nazionale di Fisica Nucleare, Sezione di Milano · National Institute for Astrophysics

    Affiliation as printed

    Dipartimento di Fisica “Aldo Pontremoli”, Università degli Studi di Milano

    INAF-IASF Milano

    INFN-Sezione di Milano

  80. Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

  81. Trieste Astronomical Observatory · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Trieste

  82. FHNW University of Applied Sciences and Arts Northwestern Switzerland

    Affiliation as printed

    University of Applied Sciences and Arts of Northwestern Switzerland, School of Computer Science

  83. University of Bonn

    Affiliation as printed

    Universität Bonn, Argelander-Institut für Astronomie

  84. Astronomical Observatory of Rome · Istituto Nazionale di Fisica Nucleare, Sezione di Roma I · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Roma

    INFN-Sezione di Roma

  85. Centre National de la Recherche Scientifique · Aix-Marseille Université · Laboratoire d’Astrophysique de Marseille

    Affiliation as printed

    Aix-Marseille Université, CNRS, CNES, LAM

    LAM - Laboratoire d'Astrophysique de Marseille (Pôle de l'Étoile Site de Château-Gombert 38, rue Frédéric Joliot-Curie 13388 Marseille cedex 13 - France)

  86. Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics · University of Bologna

    Affiliation as printed

    Dipartimento di Fisica e Astronomia “Augusto Righi” – Alma Mater Studiorum Università di Bologna

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

    INFN-Sezione di Bologna

  87. Durham University

    Affiliation as printed

    Department of Physics, Institute for Computational Cosmology, Durham University

  88. Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

  89. Centre National de la Recherche Scientifique · Université Paris Cité · Institut National de Physique Nucléaire et de Physique des Particules · Université Paris Diderot · Centre Pierre Binétruy · University of California, Berkeley

    Affiliation as printed

    CNRS-UCB International Research Laboratory, Centre Pierre Binétruy, IRL2007, CPB-IN2P3

    Université Paris Cité, CNRS, Astroparticule et Cosmologie

    APC (UMR_7164) - AstroParticule et Cosmologie (APC - UMR 7164, Université Paris Diderot, 10 rue Alice Domon et Léonie Duquet, case postale 7020, F-75205 Paris Cedex 13 - France)

    CPB - Centre Pierre Binétruy (UNIVERSITY OF CALIFORNIA BERKELEY - Berkeley, Physics Department 00366 LeConte Hall - United States)

  90. Centre National de la Recherche Scientifique · Institut d'Astrophysique de Paris · Sorbonne Université

    Affiliation as printed

    Institut d’Astrophysique de Paris

    Institut d’Astrophysique de Paris, UMR 7095, CNRS, and Sorbonne Université

    IAP - Institut d'Astrophysique de Paris (98bis, bd Arago - 75014 Paris France - France)

  91. Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

    INFN-Sezione di Bologna

  92. Astronomical Observatory of Rome · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Roma

  93. École Polytechnique Fédérale de Lausanne

    Affiliation as printed

    Institute of Physics, Laboratory of Astrophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Observatoire de Sauverny

  94. European Space Agency

    Affiliation as printed

    Telespazio UK S.L. for European Space Agency (ESA)

  95. Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics · University of Bologna

    Affiliation as printed

    Dipartimento di Fisica e Astronomia “Augusto Righi” – Alma Mater Studiorum Università di Bologna

    INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna

    INFN-Sezione di Bologna

  96. Institute for High Energy Physics · Barcelona Institute of Science and Technology · Port d'Informació Científica

    Affiliation as printed

    Institut de Física d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB

    Port d’Informació Científica

  97. European Space Agency · European Space Research and Technology Centre

    Affiliation as printed

    European Space Agency/ESTEC

    ESA - Agence Spatiale Européenne = European Space Agency (Agence spatiale européenne (ESA) 8-10, rue Mario Nikis F-75015 Paris - France)

  98. Institute for High Energy Physics · Barcelona Institute of Science and Technology

    Affiliation as printed

    Institut de Física d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB

  99. University of Geneva

    Affiliation as printed

    Department of Astronomy, University of Geneva

  100. Trieste Astronomical Observatory · National Institute for Astrophysics

    Affiliation as printed

    INAF-Osservatorio Astronomico di Trieste

Cited by 0 stored of 1

References 0