+ Reply to Thread
Results 1 to 8 of 8

Thread: Mixed models: Calculating ICC for model with a random intercept and a random slope

  1. #1
    Points: 2,138, Level: 27
    Level completed: 92%, Points required for next Level: 12

    Posts
    3
    Thanks
    2
    Thanked 1 Time in 1 Post

    Mixed models: Calculating ICC for model with a random intercept and a random slope




    Hello All,

    I have a question about how to calculate an intraclass correlation coefficient in a mixed model that has both a random intercept and a random slope. I have a very nice paper by Judith Singer that describes how to do this for a random intercept model. The paper can be accessed at:

    http://www.gse.harvard.edu/~faculty/...oc%20Mixed.pdf

    At the top of page 330, there is a formula for calculating the ICC for a random intercept model. There's also a section on individual growth models, that starts on page 340. The growth models have a random intercept and a random slope. Is there some way to extend the formula on page 330, so I can calculate the ICC for growth models like that described on pages 340 and 341? If so, how is this done?

    Thanks,

    Paul

  2. The Following User Says Thank You to pjmiller_57 For This Useful Post:

    Cynderella (07-23-2015)

  3. #2
    Cookie Scientist
    Points: 10,408, Level: 67
    Level completed: 90%, Points required for next Level: 42
    Jake's Avatar
    Location
    Austin, TX
    Posts
    1,189
    Thanks
    53
    Thanked 518 Times in 388 Posts

    Re: Mixed models: Calculating ICC for model with a random intercept and a random slop

    Hi Paul. It's a good question. I thumbed through Snijders & Bosker (2012) and couldn't find an answer. So I did a small amount of Googling and the only clue I found (in the minute or so that I spent looking online) was the page here (LINK) which had the following to say:
    For a random intercept model, the intraclass correlation was identical to the variance partitioning coefficient, and it was quite simple to calculate. For a random slopes model, the intraclass correlation is not equal to the variance partitioning coefficient because the intraclass correlation will depend on the value of x1 for each of the two elements in question. The variance partitioning coefficient just depended on one value of x1 but if two different people each have a different value of x1, both those values are going to go into the formula for the intraclass correlation. The exact expression for the intraclass correlation is quite complicated; we're not going to give it here because the important thing is simply to note that the intraclass correlation will depend on the two values of x1 as well as σ2u1, σ2u0 and σu01.
    If you find a better answer be sure to update us in this thread!
    “In God we trust. All others must bring data.”
    ~W. Edwards Deming

  4. The Following 2 Users Say Thank You to Jake For This Useful Post:

    Cynderella (07-23-2015), pjmiller_57 (09-19-2012)

  5. #3
    King of all Drama
    Points: 14,965, Level: 79
    Level completed: 23%, Points required for next Level: 385
    spunky's Avatar
    Location
    vancouver, canada
    Posts
    1,876
    Thanks
    134
    Thanked 451 Times in 361 Posts

    Re: Mixed models: Calculating ICC for model with a random intercept and a random slop

    From Kreft & De Leeuw's Introducing Multilevel Modeling, p. 63:

    "The concept of intra-class correlation is based on a model with a random intercept only. No unique intra-class correlation can be calculated when a random slope is present in the model. The value of the between variance in models with a random slope and a random intercept is a combination of slope and intercept variance (and covariance). We know from the discussin of th basic RC model that the variance of the slope (and, as a consequence, the value of the covariance) is realted to the value of the explanatory variable x. Thus the intra-class correlation between individuals will be different, in models with random slopes, for individuals with different x-values. As a result the intra-class correlation is no longer uniquely defined".
    so some people say it can't be done. other people say it can be done but it's complicated. i guess this is one of those moments where you go back to the literature and cite your favourite author in case he or she has come up with something...
    for all your psychometric needs! https://psychometroscar.wordpress.com/about/

  6. The Following 2 Users Say Thank You to spunky For This Useful Post:

    Cynderella (07-23-2015), pjmiller_57 (09-19-2012)

  7. #4
    Points: 2,138, Level: 27
    Level completed: 92%, Points required for next Level: 12

    Posts
    3
    Thanks
    2
    Thanked 1 Time in 1 Post

    Re: Mixed models: Calculating ICC for model with a random intercept and a random slop

    Hi "Spunky" and Jake,

    Thanks for your replies. So it looks like this can't be done. Or it is difficult to do correctly and will be seen as controversial by some. So I think I'll leave off trying to do this.

    Appreciate your help.

    Paul

  8. #5
    Points: 2, Level: 1
    Level completed: 3%, Points required for next Level: 48

    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Mixed models: Calculating ICC for model with a random intercept and a random slop

    Quote Originally Posted by pjmiller_57 View Post
    Hello All,

    I have a question about how to calculate an intraclass correlation coefficient in a mixed model that has both a random intercept and a random slope. I have a very nice paper by Judith Singer that describes how to do this for a random intercept model. The paper can be accessed at:

    http://www.gse.harvard.edu/~faculty/...oc%20Mixed.pdf

    At the top of page 330, there is a formula for calculating the ICC for a random intercept model. There's also a section on individual growth models, that starts on page 340. The growth models have a random intercept and a random slope. Is there some way to extend the formula on page 330, so I can calculate the ICC for growth models like that described on pages 340 and 341? If so, how is this done?

    Thanks,

    Paul
    Hi there,

    I am trying to track down the article you referenced in your prior post, but the link is not working. Would you mind posting the name of the article? I'm interested in this topic.

    Many thanks,
    Jacqueline

  9. #6
    Cookie Scientist
    Points: 10,408, Level: 67
    Level completed: 90%, Points required for next Level: 42
    Jake's Avatar
    Location
    Austin, TX
    Posts
    1,189
    Thanks
    53
    Thanked 518 Times in 388 Posts

    Re: Mixed models: Calculating ICC for model with a random intercept and a random slop

    Hi Jacqueline, since initially responding to this thread in 2012, I have since become deeply acquainted with the paper by Goldstein et al. (2002; see link below) which describes how the ICC would be calculated for such models and, at the same time, shows why the ICC is basically a pretty useless statistic for anything more complex than random-intercept models. Briefly, when there are random slopes, the ICC is a function of the predictors (the x-values) and thus can only be computed for particular sets of x-values. You could do something like report the ICC at the average of all the x-values, but this number will be demonstrably inaccurate for the majority of the data. Because of these complications, my policy for the last few years has been to simply advise against computing ICC for such models, and instead recommend that people just report the variance components (preferably in standard deviation form).

    http://seis.bris.ac.uk/~frwjb/materials/pvmm.pdf
    “In God we trust. All others must bring data.”
    ~W. Edwards Deming

  10. #7
    Points: 2,138, Level: 27
    Level completed: 92%, Points required for next Level: 12

    Posts
    3
    Thanks
    2
    Thanked 1 Time in 1 Post

    Re: Mixed models: Calculating ICC for model with a random intercept and a random slop

    Hi Jacqueline,

    Here is the reference. You should be able to download this from Judith Singer's website at Harvard.

    Singer, J. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical mod-
    els, and individual growth models. Journal of educational and behavioral statistics,
    23(4):323–355.

    Paul

    Quote Originally Posted by jsims View Post
    Hi there,

    I am trying to track down the article you referenced in your prior post, but the link is not working. Would you mind posting the name of the article? I'm interested in this topic.

    Many thanks,
    Jacqueline

  11. #8
    Test of Gnomality
    Points: 20,500, Level: 90
    Level completed: 30%, Points required for next Level: 350
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    4,080
    Thanks
    245
    Thanked 655 Times in 633 Posts

    Re: Mixed models: Calculating ICC for model with a random intercept and a random slop


    Great. The code etc. seem about right based on my limited experience, but I will note the publication data of 1998. So you may want to check SAS Proc Mixed Documentation to confirm that new options aren't available.
    "All I see are dead people."

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats