In this manifesto we want to facilitate a more explicit and consistent study of (the quality of) intensive longitudinal measurements, to move the Experience Sampling Method (ESM) field beyond face validity. We want to do this by providing the following: First, suggestions of what research questions to ask and answer that directly relate to how to measure a particular psychological processes. Second, an overview of what we consider current best practices/options/tools/methods for evaluating ILD measurements. Third, recommendations for best practices for reporting on ILD measurements.
Our key messages are:
- What works or does not work for inter-individual differences, does not necessarily generalize to intra-individual differences. This also applies to measurement, meaning that many standard tools do not directly apply to ESM type measurements.
- We will need to evaluate intra-individual reliability and validity, potentially also on a person-specific level.
- The research question and goal should be leading when designing and evaluating quality of measurements. Just like we want to tailor treatments to individuals, we want to tailor (evaluations of) our measurements to our research aims.
- How to measure intensive longitudinal data is a research question. It is pioneering work. It is an iterative process, where we learn more over time and experience by combining methodological and empirical/substantive knowledge. What is best practice may differ per research goal and substantive area.
- This work is not trying to be the end all be all of how things should be done, it is about what are current best practices and tools/ideas how we believe the field can move beyond face validity.
Included authors:
- Noémi Schuurman (Universiteit Utrecht)
- Loes Keijsers (Erasmus Universiteit Rotterdam)
- Laura Bringmann (RU Groningen)
- Marieke Wicherts (RU Groningen)