MetaSim: Meta-scientific perspectives on simulation studies
Questionable research practices, such as selective reporting of results, are often seen as a major cause of replicability problems in the medical and social sciences. These practices can also harm methodological research, but are often not recognised. In this project, we take a meta-scientific perspective on simulation experiments which are widely used in methodological research. We aim to identify problematic practices and to provide recommendations on how to avoid them.
Project Lead
Publications
- Siepe, B. S., Bartoš, F., Morris, T. P., Boulesteix, A.-L., Heck, D. W., & Pawel, S. (2024). Simulation studies for methodological research in psychology: A standardized template for planning, preregistration, and reporting. Psychological Methods. https://doi.org/10.1037/met0000695
- Pawel, S., Kook, L., & Reeve, K. (2024). Pitfalls and potentials in simulation studies: Questionable research practices in comparative simulation studies allow for spurious claims of superiority of any method. Biometrical Journal, 66(1), e2200091. https://doi.org/10.1002/bimj.202200091
- Pawel, S., Bartoš, F., Siepe, B. S., & Lohmann, A. (2024). Handling missingness, failures, and non-convergence in simulation studies: A review of current practices and recommendations. arXiv Preprint. https://doi.org/10.48550/arXiv.2409.18527