Login / Signup

A systematic review of measures of implementation players and processes: Summarizing the dearth of psychometric evidence.

Caitlin N DorseyKayne D MettertAjeng J PuspitasariLaura J DamschroderCara C Lewis
Published in: Implementation research and practice (2021)
How we measure the processes and players involved for implementing evidence-based interventions is crucial to understanding what factors are helping or hurting the intervention's use in practice and how to take the intervention to scale. Unfortunately, measures of these factors-stakeholders, their networks and communication, and their implementation activities-have received little attention. This study sought to identify and evaluate the quality of these types of measures. Our review focused on collecting measures used for identifying influential staff members, known as opinion leaders and champions, and investigating how they plan, execute, engage, and evaluate the hard work of implementation. Upon identifying these measures, we collected all published information about their uses to evaluate the quality of their evidence with respect to their ability to produce consistent results across items within each use (i.e., reliable) and if they assess what they are intending to measure (i.e., valid). Our searches located over 40 measures deployed in behavioral health settings for evaluation. We observed a dearth of evidence for reliability and validity and when evidence existed the quality was low. These findings tell us that more measurement work is needed to better understand how to optimize players and processes for the purposes of successful implementation.
Keyphrases
  • quality improvement
  • healthcare
  • primary care
  • randomized controlled trial
  • physical activity
  • systematic review
  • mental health
  • working memory
  • health information
  • climate change