+ Reply to Thread
Results 1 to 9 of 9

Thread: Low cronbach's alpha - any remedy?

  1. #1
    Points: 8,763, Level: 63
    Level completed: 5%, Points required for next Level: 287

    Posts
    25
    Thanks
    16
    Thanked 0 Times in 0 Posts

    Low cronbach's alpha - any remedy?




    Hi there,

    I want to construct a scale of 'contacting government' based on the question 'Please indicate if in the past year you contacted govt about any of the following services.' --There is a list of 14 different topics. The factor analysis (result attached) shows what to me what are logical groupings of services (for instance, police and fire together, education and youth center, etc), but the Cronbach's alpha is only .592. This of course is lower than the conventionally accepted .7. I looked at the 'show alpha if item deleted' scale and nothing will increase the alpha even over .6.

    Is it necessary to abandon this scale? Is there anything else I could try to make an acceptable measure? Other suggestions?

    My apologies for the open ended questions. I appreciate any advice.
    Attached Images  

  2. #2
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    Re: Low cronbach's alpha - any remedy?

    Quote Originally Posted by jesse View Post
    Is it necessary to abandon this scale?
    Flippant answer: Just abandon Cronbach's alpha. See On the use, the misuse, and the very limited usefulness of Cronbach’s alpha (Sijtsma, 2009).

    Slightly less flippant answer: Alpha tends to be biased downward as a measure of reliability when responses to a scale are determined by more than one underlying latent variable. No doubt this is the case here: There are probably lots of causative factors driving how often someone contacts government, with different factors underlying contacts about different issues. (Rather than one underlying factor of "propensity to contact government" that explains most the variation and covariation in the frequency of different types of contact). You can of course investigate the factor structure of responses to the instrument, though PCA is not necessarily ideal for this purpose (it isn't a true factor analysis).

    Maybe it would be worthwhile reading a little about cronbach's alpha and deciding whether it really measures something you care about and that is relevant for your scale, rather than sticking rigidly to the orthodoxy of always reporting alpha, and always sticking to the .7 rule of thumb?

  3. The Following User Says Thank You to CowboyBear For This Useful Post:

    jesse (07-23-2012)

  4. #3
    Cookie Scientist
    Points: 13,431, Level: 75
    Level completed: 46%, Points required for next Level: 219
    Jake's Avatar
    Location
    Austin, TX
    Posts
    1,293
    Thanks
    66
    Thanked 584 Times in 438 Posts

    Re: Low cronbach's alpha - any remedy?

    You could try removing items iteratively until the scale reaches what you deem to be a satisfactory alpha.

    Edit: plus what CB said about abandoning alpha
    “In God we trust. All others must bring data.”
    ~W. Edwards Deming

  5. The Following User Says Thank You to Jake For This Useful Post:

    jesse (07-23-2012)

  6. #4
    ggplot2orBust
    Points: 71,220, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    User with most referrers
    trinker's Avatar
    Location
    Buffalo, NY
    Posts
    4,417
    Thanks
    1,811
    Thanked 928 Times in 809 Posts

    Re: Low cronbach's alpha - any remedy?

    I think SPSS gives you the alpha if deleted item scores (referencing Jake's answer). Note that cronbach's uses N in the calculation, with such a low number of items alpha tends to be lower. You can add more items if this is a test run.
    "If you torture the data long enough it will eventually confess."
    -Ronald Harry Coase -

  7. The Following User Says Thank You to trinker For This Useful Post:

    jesse (07-23-2012)

  8. #5
    Points: 8,763, Level: 63
    Level completed: 5%, Points required for next Level: 287

    Posts
    25
    Thanks
    16
    Thanked 0 Times in 0 Posts

    Re: Low cronbach's alpha - any remedy?

    Thank you very much for the answers.

    @CowboyBear: Both the flippant and the much less flippant answers are helpful. There is a somewhat strong theoretical motivation for using this measure, so I will take your advice and look into how to pre-empt journal reviewer criticism.

    @Jake and trinker: Also, thanks. Unfortunately, the removal of individual or groups of items does not produce an alpha even over .6.

  9. #6
    Cookie Scientist
    Points: 13,431, Level: 75
    Level completed: 46%, Points required for next Level: 219
    Jake's Avatar
    Location
    Austin, TX
    Posts
    1,293
    Thanks
    66
    Thanked 584 Times in 438 Posts

    Re: Low cronbach's alpha - any remedy?

    You're sure? So you're saying you tried removing all possible subgroups of items and checking the alpha? Removing all possible subgroups of only sizes 1 through 5 would require 14 + 91 + 364 + 1001 + 2002 = 3472 analyses, and with 14 total items one could certainly keep going. This must have taken a while.
    “In God we trust. All others must bring data.”
    ~W. Edwards Deming

  10. #7
    Super Moderator
    Points: 13,151, Level: 74
    Level completed: 76%, Points required for next Level: 99
    Dragan's Avatar
    Location
    Illinois, US
    Posts
    2,014
    Thanks
    0
    Thanked 223 Times in 192 Posts

    Re: Low cronbach's alpha - any remedy?

    You might want to use the L-comoment (robust) based estimator of coefficient alpha, which is based on the L-correlation.

  11. The Following User Says Thank You to Dragan For This Useful Post:

    jesse (07-23-2012)

  12. #8
    Points: 8,763, Level: 63
    Level completed: 5%, Points required for next Level: 287

    Posts
    25
    Thanks
    16
    Thanked 0 Times in 0 Posts

    Re: Low cronbach's alpha - any remedy?

    Thanks for the continued interest.

    @Jake: Thank you for clarifying. No, I did not perform the tests as you suggest. Rather, I checked if removing any individual item or subset of related items would increase the alpha. It did not. I don't think I can do what you are suggesting manually. However, if there is a way to automate this process in the SPSS syntax, that might be an option.

    @Dragon: I did a quick search of journal articles in my academic field for L-correlation-based coefficient alpha estimator. If I can find a way to produce this, I will try it.

  13. #9
    Points: 88, Level: 1
    Level completed: 76%, Points required for next Level: 12

    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Low cronbach's alpha - any remedy?


    hey Jesse,

    whats your conclusion now about the low cronbach alph value. I am in the same boat. I have a pretest and post test model. pretest show .1 and post test shows .4. after removing one particular item both score increases but are at .5. I am totally confused at what to do next/

    twlight

+ Reply to Thread

           




Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats