+ Reply to Thread
Results 1 to 9 of 9

Thread: Mean centering (good bad or ugly?)

  1. #1
    ggplot2orBust
    Points: 71,220, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    User with most referrers
    trinker's Avatar
    Location
    Buffalo, NY
    Posts
    4,417
    Thanks
    1,811
    Thanked 928 Times in 809 Posts

    Mean centering (good bad or ugly?)




    As part of a regression course I have to do mean centering. I looked it up and have read 4-5 articles on it. Generally opinions are skewed in the direction that mean centering adds nothing to the interpretability (if that's a word) to the regression model. (see a paper on this by clicking here). Though there is counter literature as well.

    I'm wondering your opinions on the subject? Do you use mean centering or would you?

    EDIT: Here is a past thread on the subject (LINK)
    Last edited by trinker; 10-15-2011 at 06:52 PM. Reason: Included past thread on the subject
    "If you torture the data long enough it will eventually confess."
    -Ronald Harry Coase -

  2. #2
    TS Contributor
    Points: 22,383, Level: 93
    Level completed: 4%, Points required for next Level: 967
    spunky's Avatar
    Location
    vancouver, canada
    Posts
    2,135
    Thanks
    166
    Thanked 537 Times in 431 Posts

    Re: Mean centering (good bad or ugly?)

    thing is, without mean centering, i dont know of any other relatively easy ways to deal with the (sometimes SEVERE) multicollinearity that arises when you create an interaction or some other form of multiplicative variable to add to your model...

    and if you think centering is ugly in regression, just wait 'till you go into multilevel/mixed-effects regression where all hell breaks loose!
    for all your psychometric needs! https://psychometroscar.wordpress.com/about/

  3. #3
    TS Contributor
    Points: 22,383, Level: 93
    Level completed: 4%, Points required for next Level: 967
    spunky's Avatar
    Location
    vancouver, canada
    Posts
    2,135
    Thanks
    166
    Thanked 537 Times in 431 Posts

    Re: Mean centering (good bad or ugly?)

    i just skimmed through the article that you attached, but something caught my att'n almost at the very end, where they propose alternatives to mean centering:

    "Because collinearity problems cannot be remedied after the data has been collected
    in most cases, we recommend that researchers carefully design their research studies prior to
    collecting their data. If feasible, one can address it by using a data collection scheme that isolates
    the interaction effect (for example, a factorial design)"

    factorial designs in the social sciences where research is 99% correlational and sometimes not even that?! are you F kiddin me?!

    i dunno... sometimes i read this people saying "what we do is wrong, but our alternative to do it right is even worse" and cant help but wonder what were they thinking when they wrote that...
    for all your psychometric needs! https://psychometroscar.wordpress.com/about/

  4. #4
    ggplot2orBust
    Points: 71,220, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    User with most referrers
    trinker's Avatar
    Location
    Buffalo, NY
    Posts
    4,417
    Thanks
    1,811
    Thanked 928 Times in 809 Posts

    Re: Mean centering (good bad or ugly?)

    LMAO I appreciate the insight.

  5. #5
    Cookie Scientist
    Points: 13,431, Level: 75
    Level completed: 46%, Points required for next Level: 219
    Jake's Avatar
    Location
    Austin, TX
    Posts
    1,293
    Thanks
    66
    Thanked 584 Times in 438 Posts

    Re: Mean centering (good bad or ugly?)

    I'm going to go full disclosure and admit that I didn't read the attached article (and also that I'm drunk... so there's that). But I don't see what the issue really is? Perhaps the only purpose of mean centering is that it increases the interpretability of the parameters in your model, at least in many fairly common situations. It doesn't really change your model in a deep sense. After all, you're just rescaling one or more of the predictors, nothing more. It is especially helpful when you have interaction terms in the model and therefore the partial effect of (say) b1 only tells you about the case where b2 = 0. Obviously if b2 can never equal 0, which is the case often enough, then you will almost certainly make your life easier by mean centering b2 (and it probably wouldn't hurt to do b1 as well!). But again, nothing has *really* changed in the model, and any apparent multicollinearity issues are a complete red herring, because they are perfectly counterweighed by corresponding changes in the variance of your predictor variables when you choose to mean center vs. not mean center. The confidence intervals don't change! I can't see how anyone who really understands what is happening in regression could take a strong stance against mean centering.
    “In God we trust. All others must bring data.”
    ~W. Edwards Deming

  6. #6
    ggplot2orBust
    Points: 71,220, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    User with most referrers
    trinker's Avatar
    Location
    Buffalo, NY
    Posts
    4,417
    Thanks
    1,811
    Thanked 928 Times in 809 Posts

    Re: Mean centering (good bad or ugly?)

    That's the stance of Kromley & Foster-Johnson(1998) Mean Centering in Moderated Multiple Regression: Much Ado about Nothing. It was an interestinf read for sure. I'd link it but it's not publically available and thus would be wrong. Thank you for your drunken insight.

  7. #7
    ggplot2orBust
    Points: 71,220, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    User with most referrers
    trinker's Avatar
    Location
    Buffalo, NY
    Posts
    4,417
    Thanks
    1,811
    Thanked 928 Times in 809 Posts

    Re: Mean centering (good bad or ugly?)

    Quote Originally Posted by spunky
    i dunno... sometimes i read this people saying "what we do is wrong, but our alternative to do it right is even worse" and cant help but wonder what were they thinking when they wrote that...
    The answer is we're all pushing to get published at the expense of reason sometimes.

  8. #8
    Cookie Scientist
    Points: 13,431, Level: 75
    Level completed: 46%, Points required for next Level: 219
    Jake's Avatar
    Location
    Austin, TX
    Posts
    1,293
    Thanks
    66
    Thanked 584 Times in 438 Posts

    Re: Mean centering (good bad or ugly?)

    You mean I could have turned my post into a bona fide publication? ****!
    “In God we trust. All others must bring data.”
    ~W. Edwards Deming

  9. #9
    Devorador de queso
    Points: 95,705, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Posting AwardCommunity AwardDiscussion EnderFrequent Poster
    Dason's Avatar
    Location
    Tampa, FL
    Posts
    12,931
    Thanks
    307
    Thanked 2,629 Times in 2,245 Posts

    Re: Mean centering (good bad or ugly?)


    Yup. You would have been a shoe-in for the ASAJDP (ASA's Journal of Drunken Posts).

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats