+ Reply to Thread
Results 1 to 5 of 5

Thread: comparing means\unequal(small) size group

  1. #1
    Points: 2,316, Level: 29
    Level completed: 11%, Points required for next Level: 134

    Posts
    2
    Thanks
    0
    Thanked 0 Times in 0 Posts

    comparing means\unequal(small) size group




    Hi,
    I am about to use student t test to compare the mean of two independent groups. The first group sample size is 4 and another one is 24. Can I use t-test? Is there any other test? shall I use a nonparametric test?
    Regards,

  2. #2
    TS Contributor
    Points: 40,089, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Downloads
    gianmarco's Avatar
    Location
    Italy
    Posts
    1,367
    Thanks
    232
    Thanked 301 Times in 225 Posts

    t-test

    Hi!

    I think that the main concern (in order to use t-est or other parametric tests) is whether or not your samples are normal distributed AND have the same variance.

    If they are normal distributed AND have the same variance, use the t-test;
    if they are normal distributed BUT without same variance, use Welch's t;
    if they are not normal distributed (and I suspect that is holds true at least for the small sample), use a non-parametric test (Mann-Whitney, Kolmogorov-Smirnov).

    You can read this link (http://onlinestatbook.com/index.html) about t-test, or other link available in the web. Is very useful this: http://faculty.vassar.edu/lowry/VassarStats.html.
    It provides lessons and calculations facilities.

    I hope it helps.
    Gianmarco
    p.s.
    I have implemented an Excel's template that calculate some statistics: information available at my site (http://xoomer.virgilio.it/gianmarco....le/Page395.htm) (at the bottom of the page).

    Please note: it is the old version; I am working to a new improved version, that is about to be released.

  3. #3
    Points: 2,316, Level: 29
    Level completed: 11%, Points required for next Level: 134

    Posts
    2
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Hi,
    Thanks for the detailed reply. The normality assumption should be valid for each group individually or should I mix the two groups data and then run the test?
    Best regards

  4. #4
    TS Contributor
    Points: 40,089, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Downloads
    gianmarco's Avatar
    Location
    Italy
    Posts
    1,367
    Thanks
    232
    Thanked 301 Times in 225 Posts
    Hi,
    I believe that normality should be tested for each individual sample.
    I think that the smaller sample you have poses a serious issue in order to t-test be performed.

    I suggest you to use non-parametric test like Mann-Whitney.

    I have just remembered that you can use the permutation t-test, that tests for equality of means using the t statistic, but is non-parametric test with few assumptions. The power of the test is limited by the sample size significance at the p<0.05 level can only be achieved for n>3 in each sample.

    It is provided by a free program (http://folk.uio.no/ohammer/past/) that I consider a true jewel, since it provides many statistical analyses. Many of them are conceived for palaeontologist, but are useful to other needs as well.

    I hope it helps,
    Gm

  5. #5
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    As gianmarco says, the choice between parametric and non-parametric tests is more to do with distributional/data characteristics than sample size. I.e., using non-parametric tests is not going to help the fact that your sample size is too small

    E.g., using the t-test and assuming normality, even if the population difference between the two groups is a full population standard deviation (effect size = 1, a very large population difference), your statistical power or chance of correctly rejecting the null hypothesis is only about 58% (from http://www.dssresearch.com/toolkit/spcalc/power.asp). You usually want power of over 80%. If normality is not present (whether or not you use a non-parametric test), this power will be even lower. Try using the calculator with better estimates of the difference and standard deviations to see how it looks.

    In sum: I'd suggest either trying to increase your sample size (especially in the first group), or if this isn't feasible, focusing on descriptive rather than inferential statistics.

    Good luck
    Matt aka CB | twitter.com/matthewmatix

+ Reply to Thread

           




Similar Threads

  1. Unequal (small) sample size?
    By acifter in forum Statistics
    Replies: 0
    Last Post: 04-18-2011, 07:37 AM
  2. Comparing Group Means
    By edresearcher in forum Statistics
    Replies: 2
    Last Post: 11-02-2010, 06:34 PM
  3. comparing means in samples with unequal n
    By yakodik in forum Psychology Statistics
    Replies: 8
    Last Post: 10-11-2010, 04:23 AM
  4. Help needed: multiple test in a small size group
    By sandsoppa in forum Other Software
    Replies: 1
    Last Post: 09-25-2009, 09:50 PM
  5. Replies: 2
    Last Post: 06-04-2008, 02:44 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats