+ Reply to Thread
Results 1 to 8 of 8

Thread: Interpreting Kruskal-Wallis test

  1. #1
    Points: 22, Level: 1
    Level completed: 43%, Points required for next Level: 28

    Posts
    3
    Thanks
    3
    Thanked 0 Times in 0 Posts

    Interpreting Kruskal-Wallis test




    My question arises from a paper I read. Two groups are compared using the non-parametric Kruskal-Wallis test. Neither group has data that is normally distributed. Group A data is skewed low and has a mean that is lower than the median. Group B data is skewed high and has a mean that is higher than the median. Group A has a lower mean but a higher median than group B. The analysis provided in the paper stated the groups are different (p<0.01) by Kruskal Wallis (which in itself surprised me). But they also stated group B had higher results than group A, but that is based on the mean, but if one used the median value you would assume that A was higher than B. Besides showing that the groups are different, does Kruskal Wallis allow you to state which is the higher of the two?

  2. #2
    Omega Contributor
    Points: 38,374, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    6,998
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: Interpreting Kruskal-Wallis test

    KW is typically used with 3 or more groups, not two.


    It is based on rank ordering all of the values and seeing if one group had more highly ranked values than the other group. So yeah, I would imagine if you had a significant value you could try to discern which group had more highly ranked observations.
    Stop cowardice, ban guns!

  3. The Following User Says Thank You to hlsmith For This Useful Post:

    JRA (03-03-2016)

  4. #3
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    Re: Interpreting Kruskal-Wallis test

    KW is not a test of equality of medians or means (or it can only be interpreted that way if the shape and spread of the two distributions are identical). It can be interpreted in a broad sense as indicating which population "tends to" have higher values.

    More specifically, if we're looking at just two groups (making the KW test equivalent to a Mann-Whitney test), then the null hypothesis being tested is that:

    If you randomly select an observation Y1 from Population 1 and randomly select an observation Y2 from Population 2, then the probability that Y2 is greater than Y1 is exactly 0.5.

  5. The Following User Says Thank You to CowboyBear For This Useful Post:

    JRA (03-03-2016)

  6. #4
    Points: 22, Level: 1
    Level completed: 43%, Points required for next Level: 28

    Posts
    3
    Thanks
    3
    Thanked 0 Times in 0 Posts

    Re: Interpreting Kruskal-Wallis test

    Thanks for the responses. The point that Mann Whitney or KW are not tests of mean or median is helpful, they are tests of ranks. But at some point, once a difference is noted between groups, researchers want to assign directionality to the difference. If group A and B are found to have different serum bilirubin by MW test, when writing a paper the researcher will want to state "disease X is characterized by higher (or lower) bilirubin values. In some cases the directionality is obvious. in the case I describe there is large overlap. In order to assign a directionality of the difference, there must be some quantitative way this is done. Is it done by looking at the sum of ranks?

  7. #5
    TS Contributor
    Points: 40,621, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Downloads
    gianmarco's Avatar
    Location
    Italy
    Posts
    1,368
    Thanks
    232
    Thanked 301 Times in 225 Posts

    Re: Interpreting Kruskal-Wallis test

    The sum of ranks will be higher in the sample that tends to have higher values. You can also use boxplots to have a visual "understanding" of which sample is featured by higher values.
    For MW you can also compute the 'probability of superiority' statistic: more info HERE

    gm
    http://cainarchaeology.weebly.com/

  8. The Following 3 Users Say Thank You to gianmarco For This Useful Post:

    CowboyBear (03-03-2016), JRA (03-03-2016), rogojel (03-03-2016)

  9. #6
    Points: 22, Level: 1
    Level completed: 43%, Points required for next Level: 28

    Posts
    3
    Thanks
    3
    Thanked 0 Times in 0 Posts

    Re: Interpreting Kruskal-Wallis test

    Thanks to Gianmarco for the comments. Actually, it was the box plot that led me to question the authors comments about which group was higher. The spread of the data in each group was so odd that I believe the author and I came to different conclusions about the data. That is why I was looking for an objective approach to the issue. Again, thanks to all for the comments.

  10. #7
    TS Contributor
    Points: 12,227, Level: 72
    Level completed: 45%, Points required for next Level: 223
    rogojel's Avatar
    Location
    I work in Europe, live in Hungary
    Posts
    1,470
    Thanks
    160
    Thanked 332 Times in 312 Posts

    Re: Interpreting Kruskal-Wallis test

    hi gianmarco,
    the probability of superiority is calculated using bootstrap? That could be a great measure for all kinds of two-sample tests I would say. Do you know of other cases where it is used?

  11. #8
    TS Contributor
    Points: 40,621, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Downloads
    gianmarco's Avatar
    Location
    Italy
    Posts
    1,368
    Thanks
    232
    Thanked 301 Times in 225 Posts

    Re: Interpreting Kruskal-Wallis test


    Hello rogojel,
    do you mean in general, or in my R code?
    The version of PS that I have seen so far is calculated on the basis of the U statistic. I believe that bootstrapping (or better yet, randomizing) PS in order to attach a p value would not be difficult to implement, but I have not the statistical background to say that it would be theoretically sound.
    I happen to see the use of PS in a couple of articles, but it would be interesting googling a bit to see what pops up.

    Best
    Gm
    http://cainarchaeology.weebly.com/

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats