Chapter 13 Some analytic techniques to help

Take advantage of larger datasets with techniques designed to avoid overfitting

  • Cross-validation
  • Holdout datasets

Even if your sample is small, you can protect the robustness of your results.

  • Data blind analyses (shuffle variable labels or add noise to data when developing code and analytic plan)
  • Adjusted alpha levels
  • Coordinated analysis
  • Label results as exploratory