+ Reply to Thread
Results 1 to 1 of 1

Thread: Multiple-testing correction in Moderation analyses

  1. #1
    Points: 379, Level: 7
    Level completed: 58%, Points required for next Level: 21

    Thanked 0 Times in 0 Posts

    Multiple-testing correction in Moderation analyses

    Hi Everyone!

    In an exploratory attempt, I ran 35 moderation analyses (both 2-way and 3-way interactions) of which 7 were significant. NOw the reviewer is warning me about false positives and prompting to run some statistical check that would help to identify those. I tried the conservative Bonferroni and the more liberal Benjamini-Hochberg procedures and both of them literally kill my results.

    After reading zillions of threads, papers and entries about multiple-testing, i came to realize that none of them discussed moderation analysis, i.e. they talked about the predictive potential of single variables rather than interaction terms.

    To what extent might multiple testing be a problem in moderation analysis? I intuitively think that moderation analyses might be more robust to the alpha inflation due to multiple testing, but I guess I cannot quote my intuition in a manuscript.

    Any thoughts in this regard?

    Thank you in advance!
    Last edited by rsfrzh; 03-27-2015 at 05:26 PM.

+ Reply to Thread


Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Advertise on Talk Stats