Login / Signup

Understanding 'it depends' in ecology: a guide to hypothesising, visualising and interpreting statistical interactions.

Rebecca SpakeDiana E BowlerCorey T CallaghanShane A BlowesC Patrick DoncasterLaura H AntãoShinichi NakagawaRichard L McElreathJonathan M Chase
Published in: Biological reviews of the Cambridge Philosophical Society (2023)
Ecologists routinely use statistical models to detect and explain interactions among ecological drivers, with a goal to evaluate whether an effect of interest changes in sign or magnitude in different contexts. Two fundamental properties of interactions are often overlooked during the process of hypothesising, visualising and interpreting interactions between drivers: the measurement scale - whether a response is analysed on an additive or multiplicative scale, such as a ratio or logarithmic scale; and the symmetry - whether dependencies are considered in both directions. Overlooking these properties can lead to one or more of three inferential errors: misinterpretation of (i) the detection and magnitude (Type-D error), and (ii) the sign of effect modification (Type-S error); and (iii) misidentification of the underlying processes (Type-A error). We illustrate each of these errors with a broad range of ecological questions applied to empirical and simulated data sets. We demonstrate how meta-analysis, a widely used approach that seeks explicitly to characterise context dependence, is especially prone to all three errors. Based on these insights, we propose guidelines to improve hypothesis generation, testing, visualisation and interpretation of interactions in ecology.
Keyphrases
  • systematic review
  • patient safety
  • adverse drug
  • climate change
  • randomized controlled trial
  • electronic health record
  • emergency department
  • meta analyses
  • risk assessment
  • big data
  • sensitive detection