+ Reply to Thread
Results 1 to 6 of 6

Thread: ANOSIM: significant p-value and small R-value. How?

  1. #1
    Points: 2,038, Level: 27
    Level completed: 26%, Points required for next Level: 112

    Posts
    7
    Thanks
    0
    Thanked 0 Times in 0 Posts

    ANOSIM: significant p-value and small R-value. How?




    I am analyzing data of a large sample size ('000's of samples) via one-way ANOSIM.

    Results appear contradictory: Highly significant p-value (0.001) and very small R-value (0.02).

    How is this possible? What is the correct interpretation of these results?

    nMDS shows no clustering.

    Thanks very much for any assistance.

  2. #2
    Devorador de queso
    Points: 95,540, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Posting AwardCommunity AwardDiscussion EnderFrequent Poster
    Dason's Avatar
    Location
    Tampa, FL
    Posts
    12,930
    Thanks
    307
    Thanked 2,629 Times in 2,245 Posts

    Re: ANOSIM: significant p-value and small R-value. How?

    Well you did say you have a large sample size.
    I don't have emotions and sometimes that makes me very sad.

  3. #3
    Points: 2,038, Level: 27
    Level completed: 26%, Points required for next Level: 112

    Posts
    7
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: ANOSIM: significant p-value and small R-value. How?

    Are you able to explain how this affects the interpretation of the p-value? I've had difficulty finding information.

    Thank you.

  4. #4
    Omega Contributor
    Points: 38,253, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    6,989
    Thanks
    397
    Thanked 1,185 Times in 1,146 Posts

    Re: ANOSIM: significant p-value and small R-value. How?

    Not familiar with your approach but typically in test statistics the standard error is a component of the denominator. Large sample sizes make the error smaller and effects larger. For a general idea look at the t -test. What is the denominator, square root of standard deviation divided by the sample size. The bigger the sample size the smaller the denominator. Thus with the exact same numerator but bigger sample size the test statistic value will get bigger and bigger.
    Stop cowardice, ban guns!

  5. #5
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    Re: ANOSIM: significant p-value and small R-value. How?

    The results are not contradictory. The p value tells you the probability of seeing a test statistic as or more extreme than that observed in your sample if the null hypothesis is true in the population. The R-value tells you about the size of the differences found.

    With a very large sample, even a very small relationship (or group difference) could produce a significant p value and allow you to reject the null hypothesis.

    A small p value does not indicate that the relationship or different found is large, or practically significant.

  6. #6
    Points: 2,038, Level: 27
    Level completed: 26%, Points required for next Level: 112

    Posts
    7
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: ANOSIM: significant p-value and small R-value. How?


    Thanks all for your comments. That makes it clearer for me.

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats