Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with statistically unsound ad hoc methods, involving intersection of parameter intervals estimated by multiple experiments, and random or grid sampling of model parameters. Whilst these methods are easy to apply, they exhibit pathologies even in low-dimensional parameter spaces, and quickly become problematic to use and interpret in higher dimensions. In this article we give clear guidance for going beyond these procedures, suggesting where possible simple methods for performing statistically sound inference, and recommendations of readily-available software tools and standards that can assist in doing so. Our aim is to provide any physicists lacking comprehensive statistical training with recommendations for reaching correct scientific conclusions, with only a modest increase in analysis burden. Our examples can be reproduced with the code publicly available at Zenodo.

Simple and statistically sound recommendations for analysing physical theories / Abdussalam, S. S.; Agocs, F. J.; Allanach, B. C.; Athron, P.; Balazs, C.; Bagnaschi, E.; Bechtle, P.; Buchmueller, O.; Beniwal, A.; Bhom, J.; Bloor, S.; Bringmann, T.; Buckley, A.; Butter, A.; Camargo-Molina, J. E.; Chrzaszcz, M.; Conrad, J.; Cornell, J. M.; Danninger, M.; De Blas, J.; De Roeck, A.; Desch, K.; Dolan, M.; Dreiner, H.; Eberhardt, O.; Ellis, J.; Farmer, B.; Fedele, M.; Flacher, H.; Fowlie, A.; Gonzalo, T. E.; Grace, P.; Hamer, M.; Handley, W.; Harz, J.; Heinemeyer, S.; Hoof, S.; Hotinli, S.; Jackson, P.; Kahlhoefer, F.; Kowalska, K.; Kramer, M.; Kvellestad, A.; Martinez, M. L.; Mahmoudi, F.; Santos, D. M.; Martinez, G. D.; Mishima, S.; Olive, K.; Paul, A.; Prim, M. T.; Porod, W.; Raklev, A.; Renk, J. J.; Rogan, C.; Roszkowski, L.; Ruiz De Austri, R.; Sakurai, K.; Scaffidi, A.; Scott, P.; Sessolo, E. M.; Stefaniak, T.; Stocker, P.; Su, W.; Trojanowski, S.; Trotta, R.; Sming Tsai, Y. -L.; Van Den Abeele, J.; Valli, M.; Vincent, A. C.; Weiglein, G.; White, M.; Wienemann, P.; Wu, L.; Zhang, Y.. - In: REPORTS ON PROGRESS IN PHYSICS. - ISSN 0034-4885. - 85:5(2022), pp. 1-11. [10.1088/1361-6633/ac60ac]

Simple and statistically sound recommendations for analysing physical theories

Bringmann T.;Camargo-Molina J. E.;Fedele M.;Harz J.;Kramer M.;Mahmoudi F.;Mishima S.;Scaffidi A.;Trotta R.;Valli M.;White M.;
2022-01-01

Abstract

Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with statistically unsound ad hoc methods, involving intersection of parameter intervals estimated by multiple experiments, and random or grid sampling of model parameters. Whilst these methods are easy to apply, they exhibit pathologies even in low-dimensional parameter spaces, and quickly become problematic to use and interpret in higher dimensions. In this article we give clear guidance for going beyond these procedures, suggesting where possible simple methods for performing statistically sound inference, and recommendations of readily-available software tools and standards that can assist in doing so. Our aim is to provide any physicists lacking comprehensive statistical training with recommendations for reaching correct scientific conclusions, with only a modest increase in analysis burden. Our examples can be reproduced with the code publicly available at Zenodo.
2022
85
5
1
11
052201
10.1088/1361-6633/ac60ac
https://arxiv.org/abs/2012.09874
Abdussalam, S. S.; Agocs, F. J.; Allanach, B. C.; Athron, P.; Balazs, C.; Bagnaschi, E.; Bechtle, P.; Buchmueller, O.; Beniwal, A.; Bhom, J.; Bloor, S.; Bringmann, T.; Buckley, A.; Butter, A.; Camargo-Molina, J. E.; Chrzaszcz, M.; Conrad, J.; Cornell, J. M.; Danninger, M.; De Blas, J.; De Roeck, A.; Desch, K.; Dolan, M.; Dreiner, H.; Eberhardt, O.; Ellis, J.; Farmer, B.; Fedele, M.; Flacher, H.; Fowlie, A.; Gonzalo, T. E.; Grace, P.; Hamer, M.; Handley, W.; Harz, J.; Heinemeyer, S.; Hoof, S.; Hotinli, S.; Jackson, P.; Kahlhoefer, F.; Kowalska, K.; Kramer, M.; Kvellestad, A.; Martinez, M. L.; Mahmoudi, F.; Santos, D. M.; Martinez, G. D.; Mishima, S.; Olive, K.; Paul, A.; Prim, M. T.; Porod, W.; Raklev, A.; Renk, J. J.; Rogan, C.; Roszkowski, L.; Ruiz De Austri, R.; Sakurai, K.; Scaffidi, A.; Scott, P.; Sessolo, E. M.; Stefaniak, T.; Stocker, P.; Su, W.; Trojanowski, S.; Trotta, R.; Sming Tsai, Y. -L.; Van Den Abeele, J.; Valli, M.; Vincent, A. C.; Weiglein, G.; White, M.; Wienemann, P.; Wu, L.; Zhang, Y.
File in questo prodotto:
File Dimensione Formato  
AbdusSalam_2022_Rep._Prog._Phys._85_052201.pdf

non disponibili

Descrizione: pdf editoriale
Tipologia: Versione Editoriale (PDF)
Licenza: Non specificato
Dimensione 1.33 MB
Formato Adobe PDF
1.33 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11767/133772
Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 9
social impact