Euclid preparation
Astronomy and Astrophysics, vol. 708, pp. A167
Abstract
We develop techniques for generating accurate and precise internal covariances for measurements of clustering and weak-lensing angular power spectra. These methods have been designed to produce non-singular and unbiased covariances for Euclid ’s large anticipated data vector and will be critical for validation against observational systematic effects. We constructed jackknife segments that are equal in area to a high precision by adapting the binary space partition algorithm to work on arbitrarily shaped regions on the unit sphere. Jackknife estimates of the covariances are internally derived and require no assumptions about cosmology or galaxy population and bias. Our covariance estimation, called DICES (Debiased Internal Covariance Estimation with Shrinkage), first estimated a noisy covariance through conventional delete-1 jackknife resampling. This was followed by linear shrinkage of the empirical correlation matrix towards the Gaussian prediction, rather than linear shrinkage of the covariance matrix. Shrinkage ensures the covariance is non-singular and therefore invertible, which is critical for the estimation of likelihoods and validation. We then applied a delete-2 jackknife bias correction to the diagonal components of the jackknife covariance that removed the general tendency for jackknife error estimates to be biased high. We validated internally derived covariances, which used the jackknife resampling technique, on synthetic Euclid -like lognormal catalogues. We demonstrate that DICES produces accurate, non-singular covariance estimates, with the relative error improving by 33% for the covariance and 48% for the correlation structure in comparison to jackknife estimates. These estimates can be used for highly accurate regression and inference.
Authors 100
-
University College London · University of Portsmouth
Affiliation as printed
Department of Physics and Astronomy, University College London
Institute of Cosmology and Gravitation, University of Portsmouth
-
Affiliation as printed
Department of Physics and Astronomy, University College London
-
Affiliation as printed
Department of Physics and Astronomy, University College London
-
Affiliation as printed
Department of Physics and Astronomy, University College London
-
Stockholm University · Imperial College London
Affiliation as printed
Astrophysics Group, Blackett Laboratory, Imperial College London
Oskar Klein Centre for Cosmoparticle Physics, Department of Physics, Stockholm University
-
Centre National de la Recherche Scientifique · Université Paris-Saclay · Institut d'Astrophysique Spatiale
Affiliation as printed
Université Paris-Saclay, CNRS, Institut d’astrophysique spatiale
IAS - Institut d'astrophysique spatiale (Bâtiment 121 91405 ORSAY CEDEX - France)
-
European Space Agency · European Space Astronomy Centre
Affiliation as printed
ESAC/ESA
-
Affiliation as printed
School of Mathematics and Physics, University of Surrey
-
Affiliation as printed
Institut für Theoretische Physik, University of Heidelberg
-
Brera Astronomical Observatory · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Brera
-
Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
-
Scuola Internazionale Superiore di Studi Avanzati · Trieste Astronomical Observatory · Istituto Nazionale di Fisica Nucleare, Sezione di Trieste · Institute for Fundamental Physics of the Universe · National Institute for Astrophysics
Affiliation as printed
IFPU, Institute for Fundamental Physics of the Universe
INAF-Osservatorio Astronomico di Trieste
INFN, Sezione di Trieste
SISSA, International School for Advanced Studies
-
Centre National d'Études Spatiales
Affiliation as printed
Centre National d’Etudes Spatiales – Centre spatial de Toulouse
CNES - Centre National d'Études Spatiales [Toulouse] (18 avenue Edouard Belin 31401 Toulouse - France)
-
Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics · University of Bologna
Affiliation as printed
Dipartimento di Fisica e Astronomia, Università di Bologna
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
INFN-Sezione di Bologna
-
Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
-
Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
-
Trieste Astronomical Observatory · Institute for Fundamental Physics of the Universe · National Institute for Astrophysics
Affiliation as printed
IFPU, Institute for Fundamental Physics of the Universe
INAF-Osservatorio Astronomico di Trieste
-
Brera Astronomical Observatory · Istituto Nazionale di Fisica Nucleare, Sezione di Genova · University of Genoa · National Institute for Astrophysics
Affiliation as printed
Dipartimento di Fisica, Università di Genova
INAF-Osservatorio Astronomico di Brera
INFN-Sezione di Genova
-
Astronomical Observatory of Capodimonte · University of Naples Federico II · National Institute for Astrophysics
Affiliation as printed
Department of Physics “E. Pancini”, University Federico II
INAF-Osservatorio Astronomico di Capodimonte
-
Istituto Nazionale di Fisica Nucleare, Sezione di Torino · Osservatorio Astrofisico di Torino · University of Turin · National Institute for Astrophysics
Affiliation as printed
Dipartimento di Fisica, Università degli Studi di Torino
INAF-Osservatorio Astrofisico di Torino
INFN-Sezione di Torino
-
Osservatorio Astrofisico di Torino · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astrofisico di Torino
-
National Institute for Astrophysics
Affiliation as printed
INAF-IASF Milano
-
Astronomical Observatory of Rome · Istituto Nazionale di Fisica Nucleare, Sezione di Roma I · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Roma
INFN-Sezione di Roma
-
Port d'Informació Científica · Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas
Affiliation as printed
Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas (CIEMAT)
Port d’Informació Científica
-
Astronomical Observatory of Rome · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Roma
-
Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
-
Istituto Nazionale di Fisica Nucleare · Astronomical Observatory of Capodimonte · Istituto Nazionale di Fisica Nucleare, Sezione di Napoli · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Capodimonte
INFN section of Naples
-
University of Hawaiʻi at Mānoa · University of Hawaii System
Affiliation as printed
Institute for Astronomy, University of Hawaii
-
Affiliation as printed
Dipartimento di Fisica e Astronomia “Augusto Righi” – Alma Mater Studiorum Università di Bologna
-
Instituto de Astrofísica de Canarias
Affiliation as printed
Instituto de Astrofísica de Canarias
-
Royal Observatory · University of Edinburgh
Affiliation as printed
Institute for Astronomy, University of Edinburgh, Royal Observatory
-
European Space Agency · European Space Astronomy Centre · European Space Research Institute
Affiliation as printed
ESAC/ESA
European Space Agency/ESRIN
-
Lyon 1 Université · Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Institut de Physique des 2 Infinis de Lyon
Affiliation as printed
Université Claude Bernard Lyon 1, CNRS/IN2P3, IP2I Lyon, UMR 5822
IP2I Lyon - Institut de Physique des 2 Infinis de Lyon (Campus LyonTech-la Doua Bâtiment Paul DIRAC 4 Rue Enrico Fermi 69622 Villeurbanne Cedex - France)
-
Institució Catalana de Recerca i Estudis Avançats · Institut de Ciències del Cosmos · Universitat de Barcelona
Affiliation as printed
Institució Catalana de Recerca i Estudis Avançats (ICREA)
Institut de Ciències del Cosmos (ICCUB), Universitat de Barcelona (IEEC-UB)
-
Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Institut de Physique des 2 Infinis de Lyon
Affiliation as printed
UCB Lyon 1, CNRS/IN2P3, IUF, IP2I Lyon
IP2I Lyon - Institut de Physique des 2 Infinis de Lyon (Campus LyonTech-la Doua Bâtiment Paul DIRAC 4 Rue Enrico Fermi 69622 Villeurbanne Cedex - France)
-
University of Lisbon · Institute of Astrophysics and Space Sciences
Affiliation as printed
Departamento de Física, Faculdade de Ciências, Universidade de Lisboa
Instituto de Astrofísica e Ciências do Espaço, Faculdade de Ciências, Universidade de Lisboa
-
Affiliation as printed
Department of Astronomy, University of Geneva
-
Trieste Astronomical Observatory · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Trieste
-
Affiliation as printed
Department of Astronomy, University of Geneva
-
European Space Agency · European Space Astronomy Centre
Affiliation as printed
ESAC/ESA
-
Istituto Nazionale di Fisica Nucleare · Istituto Nazionale di Fisica Nucleare, Sezione di Padova
Affiliation as printed
INFN-Padova
-
Centre National de la Recherche Scientifique · Aix-Marseille Université · Centre de physique des particules de Marseille · Institut National de Physique Nucléaire et de Physique des Particules
Affiliation as printed
Aix-Marseille Université, CNRS/IN2P3, CPPM
CPPM - Centre de Physique des Particules de Marseille (163, avenue de Luminy - Case 902 - 13288 Marseille cedex 09 - France)
-
Institute for Space Astrophysics and Planetology · National Institute for Astrophysics
Affiliation as printed
INAF-Istituto di Astrofisica e Planetologia Spaziali
-
Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
-
Centre National de la Recherche Scientifique · Université Paris Cité · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · CEA Paris-Saclay - Etablissement de Saclay · Astrophysique, Instrumentation et Modélisation · CEA Paris-Saclay
Affiliation as printed
Université Paris-Saclay, Université Paris Cité, CEA, CNRS, AIM
AIM (UMR_7158 / UMR_E_9005 / UM_112) - Astrophysique Interprétation Modélisation (AIM - UMR 7158 - UMR E 9005, ex 'Astrophysique Interactions Multi-échelles', Service d'astrophysique, CEA/Saclay, Orme des Merisiers F-91191 GIF SUR YVETTE CEDEX - France)
-
Astronomical Observatory of Rome · Agenzia Spaziale Italiana · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Roma
Space Science Data Center, Italian Space Agency
-
Lyon 1 Université · Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Institut de Physique des 2 Infinis de Lyon
Affiliation as printed
Université Claude Bernard Lyon 1, CNRS/IN2P3, IP2I Lyon, UMR 5822
IP2I Lyon - Institut de Physique des 2 Infinis de Lyon (Campus LyonTech-la Doua Bâtiment Paul DIRAC 4 Rue Enrico Fermi 69622 Villeurbanne Cedex - France)
-
Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
INFN-Bologna
-
Institute of Space Sciences · Institut d'Estudis Espacials de Catalunya · Universitat Politècnica de Catalunya
Affiliation as printed
Institut d’Estudis Espacials de Catalunya (IEEC), Edifici RDIT, Campus UPC
Institute of Space Sciences (ICE, CSIC), Campus UAB
-
Trieste Astronomical Observatory · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Trieste
-
Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
-
National Institute for Astrophysics
Affiliation as printed
INAF-IASF Milano
-
Trieste Astronomical Observatory · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Trieste
-
Ludwig-Maximilians-Universität München
Affiliation as printed
Universitäts-Sternwarte München, Fakultät für Physik, Ludwig-Maximilians-Universität München
-
Royal Observatory · University of Edinburgh
Affiliation as printed
Institute for Astronomy, University of Edinburgh, Royal Observatory
-
Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
INFN-Sezione di Bologna
-
Max Planck Institute for Extraterrestrial Physics
Affiliation as printed
Max Planck Institute for Extraterrestrial Physics
-
Osservatorio Astronomico di Padova · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Padova
-
Max Planck Institute for Extraterrestrial Physics · Ludwig-Maximilians-Universität München
Affiliation as printed
Max Planck Institute for Extraterrestrial Physics
Universitäts-Sternwarte München, Fakultät für Physik, Ludwig-Maximilians-Universität München
-
Affiliation as printed
Jet Propulsion Laboratory, California Institute of Technology
-
Affiliation as printed
Felix Hormuth Engineering
-
Technical University of Denmark
Affiliation as printed
Cosmic Dawn Center (DAWN)
Technical University of Denmark
-
Max Planck Institute for Astronomy
Affiliation as printed
Max-Planck-Institut für Astronomie
-
Affiliation as printed
NASA Goddard Space Flight Center
-
Affiliation as printed
Department of Physics and Helsinki Institute of Physics
-
Centre National de la Recherche Scientifique · Aix-Marseille Université · Centre de physique des particules de Marseille · Institut National de Physique Nucléaire et de Physique des Particules
Affiliation as printed
Aix-Marseille Université, CNRS/IN2P3, CPPM
CPPM - Centre de Physique des Particules de Marseille (163, avenue de Luminy - Case 902 - 13288 Marseille cedex 09 - France)
-
Affiliation as printed
Jet Propulsion Laboratory, California Institute of Technology
-
Centre National de la Recherche Scientifique · Université Paris Cité · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · CEA Paris-Saclay - Etablissement de Saclay · Astrophysique, Instrumentation et Modélisation · CEA Paris-Saclay
Affiliation as printed
Université Paris-Saclay, Université Paris Cité, CEA, CNRS, AIM
AIM (UMR_7158 / UMR_E_9005 / UM_112) - Astrophysique Interprétation Modélisation (AIM - UMR 7158 - UMR E 9005, ex 'Astrophysique Interactions Multi-échelles', Service d'astrophysique, CEA/Saclay, Orme des Merisiers F-91191 GIF SUR YVETTE CEDEX - France)
-
Lyon 1 Université · Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Institut de Physique des 2 Infinis de Lyon
Affiliation as printed
Université Claude Bernard Lyon 1, CNRS/IN2P3, IP2I Lyon, UMR 5822
IP2I Lyon - Institut de Physique des 2 Infinis de Lyon (Campus LyonTech-la Doua Bâtiment Paul DIRAC 4 Rue Enrico Fermi 69622 Villeurbanne Cedex - France)
-
Ludwig-Maximilians-Universität München
Affiliation as printed
Universitäts-Sternwarte München, Fakultät für Physik, Ludwig-Maximilians-Universität München
-
Affiliation as printed
Université de Genève, Département de Physique Théorique and Centre for Astroparticle Physics
-
Affiliation as printed
Department of Physics
Helsinki Institute of Physics
-
Centre National de la Recherche Scientifique · Université Paris Sciences et Lettres · Observatoire de Paris · Sorbonne Université · Laboratoire d'Étude de l'Univers et des Phénomènes Extrêmes
Affiliation as printed
Laboratoire d’etude de l’Univers et des phenomenes eXtremes, Observatoire de Paris, Université PSL, Sorbonne Université, CNRS
-
Osservatorio Astrofisico di Torino · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astrofisico di Torino
-
Affiliation as printed
Institute of Theoretical Astrophysics, University of Oslo
-
Affiliation as printed
Department of Physics
Helsinki Institute of Physics
-
Affiliation as printed
SKA Observatory
-
Centre National de la Recherche Scientifique · Institut National de Physique Nucléaire et de Physique des Particules · Centre de Calcul de l’Institut National de Physique Nucléaire et de Physique des Particules
Affiliation as printed
Centre de Calcul de l’IN2P3/CNRS
CC-IN2P3 - Centre de Calcul de l'IN2P3 (Domaine scientifique de La Doua 43 bd du 11 Novembre 1918 69622 Villeurbanne Cedex - France)
-
University of Milan · Istituto Nazionale di Fisica Nucleare, Sezione di Milano · National Institute for Astrophysics
Affiliation as printed
Dipartimento di Fisica “Aldo Pontremoli”, Università degli Studi di Milano
INAF-IASF Milano
INFN-Sezione di Milano
-
Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
-
Trieste Astronomical Observatory · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Trieste
-
FHNW University of Applied Sciences and Arts Northwestern Switzerland
Affiliation as printed
University of Applied Sciences and Arts of Northwestern Switzerland, School of Computer Science
-
Affiliation as printed
Universität Bonn, Argelander-Institut für Astronomie
-
Astronomical Observatory of Rome · Istituto Nazionale di Fisica Nucleare, Sezione di Roma I · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Roma
INFN-Sezione di Roma
-
Centre National de la Recherche Scientifique · Aix-Marseille Université · Laboratoire d’Astrophysique de Marseille
Affiliation as printed
Aix-Marseille Université, CNRS, CNES, LAM
LAM - Laboratoire d'Astrophysique de Marseille (Pôle de l'Étoile Site de Château-Gombert 38, rue Frédéric Joliot-Curie 13388 Marseille cedex 13 - France)
-
Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics · University of Bologna
Affiliation as printed
Dipartimento di Fisica e Astronomia “Augusto Righi” – Alma Mater Studiorum Università di Bologna
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
INFN-Sezione di Bologna
-
Affiliation as printed
Department of Physics, Institute for Computational Cosmology, Durham University
-
Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
-
Centre National de la Recherche Scientifique · Université Paris Cité · Institut National de Physique Nucléaire et de Physique des Particules · Université Paris Diderot · Centre Pierre Binétruy · University of California, Berkeley
Affiliation as printed
CNRS-UCB International Research Laboratory, Centre Pierre Binétruy, IRL2007, CPB-IN2P3
Université Paris Cité, CNRS, Astroparticule et Cosmologie
APC (UMR_7164) - AstroParticule et Cosmologie (APC - UMR 7164, Université Paris Diderot, 10 rue Alice Domon et Léonie Duquet, case postale 7020, F-75205 Paris Cedex 13 - France)
CPB - Centre Pierre Binétruy (UNIVERSITY OF CALIFORNIA BERKELEY - Berkeley, Physics Department 00366 LeConte Hall - United States)
-
Centre National de la Recherche Scientifique · Institut d'Astrophysique de Paris · Sorbonne Université
Affiliation as printed
Institut d’Astrophysique de Paris
Institut d’Astrophysique de Paris, UMR 7095, CNRS, and Sorbonne Université
IAP - Institut d'Astrophysique de Paris (98bis, bd Arago - 75014 Paris France - France)
-
Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
INFN-Sezione di Bologna
-
Astronomical Observatory of Rome · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Roma
-
École Polytechnique Fédérale de Lausanne
Affiliation as printed
Institute of Physics, Laboratory of Astrophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Observatoire de Sauverny
-
Affiliation as printed
Telespazio UK S.L. for European Space Agency (ESA)
-
Istituto Nazionale di Fisica Nucleare, Sezione di Bologna · Osservatorio di Astrofisica e Scienza dello Spazio · National Institute for Astrophysics · University of Bologna
Affiliation as printed
Dipartimento di Fisica e Astronomia “Augusto Righi” – Alma Mater Studiorum Università di Bologna
INAF-Osservatorio di Astrofisica e Scienza dello Spazio di Bologna
INFN-Sezione di Bologna
-
Institute for High Energy Physics · Barcelona Institute of Science and Technology · Port d'Informació Científica
Affiliation as printed
Institut de Física d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB
Port d’Informació Científica
-
European Space Agency · European Space Research and Technology Centre
Affiliation as printed
European Space Agency/ESTEC
ESA - Agence Spatiale Européenne = European Space Agency (Agence spatiale européenne (ESA) 8-10, rue Mario Nikis F-75015 Paris - France)
-
Institute for High Energy Physics · Barcelona Institute of Science and Technology
Affiliation as printed
Institut de Física d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB
-
Affiliation as printed
Department of Astronomy, University of Geneva
-
Trieste Astronomical Observatory · National Institute for Astrophysics
Affiliation as printed
INAF-Osservatorio Astronomico di Trieste