+ Reply to Thread
Results 1 to 4 of 4

Thread: Certain sample size needed for HLM?

  1. #1
    Points: 2,083, Level: 27
    Level completed: 56%, Points required for next Level: 67

    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Certain sample size needed for HLM?




    I have a data set of test scores and memory scores of 111 students, nested in 12 different classroom. 6 classrooms are from high income areas and 6 from low income areas. The number of students in each classroom ranges from 2 and 12.

    I am looking to see if the effect of income area on test scores is mediated by memory capacity.

    Is this sample size of 111 too small to use for HLM?

    I want to control for the fact that the students are nested in classrooms, but think my sample may be too small?

    Kindly,
    MTT

  2. #2
    Points: 2,362, Level: 29
    Level completed: 42%, Points required for next Level: 88

    Location
    Canada
    Posts
    23
    Thanks
    0
    Thanked 1 Time in 1 Post
    MTT,
    A post on HLM power and sample size has been discussed elsewhere. You may want to see it here: http://www.talkstats.com/showthread.php?t=9366 for some preliminary thoughts.

    As an add-on, although it would be interesting to see the effects you speak of, I don't think you have sufficient people in the sample to run an HLM model. My general understanding is that you need 25 people per group (and about 25 groups) to have sufficient power to your analysis.

    Hope this helps.

  3. #3
    TS Contributor
    Points: 6,789, Level: 54
    Level completed: 20%, Points required for next Level: 161
    terzi's Avatar
    Location
    Mexico City, Mexico
    Posts
    420
    Thanks
    10
    Thanked 34 Times in 33 Posts
    It is true that you usually require large samples for this kind of models, but a small sample should not stop you from using it, if the assumptions are met.

    I'm really not a huge fan of those "rules of thumb" and I'd like to add that I'm aware of studies with a sample size of around 100 where HLM has been used. This is specially common for Longitudinal data, where you usually can't afford too many subjects in your study. Just as an example, a common popular database, the Mini Wright data, involves only 17 subjects. I really didn't like the "sampling" used in this study, but it is still a good application for HLM that didn't have many subjects available.

    Code: 
    http://books.google.com.mx/books?id=woi7AheOWSkC&pg=PA52&lpg=PA52&dq=%22martin+bland%22++model+pefr&source=bl&ots=eaKy5b1KNF&sig=JU-0J7Lpx1FHlNUPgtId9LB3I-U&hl=es&ei=T-zwSrD-DcOUtgfHscy6Cw&sa=X&oi=book_result&ct=result&resnum=1&ved=0CAgQ6AEwAA#v=onepage&q=&f=false
    So, I don't think sample size should be an impediment for developing the analysis, even if the power is low.
    Last edited by terzi; 11-03-2009 at 10:37 PM.
    Statisticians are engaged in an exhausting but exhilarating struggle with the biggest challenge that philosophy makes to science: how do we translate information into knowledge

  4. #4
    Points: 2,362, Level: 29
    Level completed: 42%, Points required for next Level: 88

    Location
    Canada
    Posts
    23
    Thanks
    0
    Thanked 1 Time in 1 Post

    I tend to agree that rules of thumb are not always ideal and should not necessarily be followed to the letter. As a matter of fact, I also see HLM designs that have 100 people or so. I think the point made is right - if you meet the assumptions with your sample, then it can be justified. However, estimating slopes of groups using 2 people may be problematic in this particular instance. I had to renounce doing HLM in my current study do to a similar problem. Without any empirical support, my general thoughts are that 10 people per group would be a nice minimum to achieve, but then again, I guess it is very sample specific.

+ Reply to Thread

           




Similar Threads

  1. Power, effect size, sample size explanation
    By lph2005 in forum Statistics
    Replies: 3
    Last Post: 12-13-2010, 03:58 PM
  2. Sample size for multi-site sample
    By DLFS in forum Statistics
    Replies: 1
    Last Post: 01-27-2009, 08:44 PM
  3. Replies: 9
    Last Post: 12-31-2008, 09:01 PM
  4. Help needed - estimating effect size
    By that_guy_ in forum Statistical Research
    Replies: 3
    Last Post: 08-05-2008, 02:00 PM
  5. Sample size for repeated measures or dependent-sample t
    By Susanbwh in forum Statistical Research
    Replies: 1
    Last Post: 02-18-2006, 02:27 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats