+ Reply to Thread
Results 1 to 6 of 6

Thread: Item Response Question

  1. #1
    Omega Contributor
    Points: 38,432, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,006
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Item Response Question




    I have received some survey data for 200 respondents.

    DV: Binary (20=1; 180=0)
    20 IVs, Likert 5-point scale and currently treated as continuous, but data are
    5 score inflated.


    I have been asked which IVs are associated with binary outcome. There is obvious sparsity in these data given the rare outcome and lack of dispersion in IVs. I ran 20 bivariate logistic models with Firth correction and alpha = 0.05/20. Most of the variables come up significant, though I believe I need to control for collinearity between variables since questions could be saying the same thing,


    I am guessing I could look at VIF and Tol tests or a correlation matrix to better figure out their inter-relationship. I am getting ready to do this. Though, is there a Factor Analysis or something else that I can use to get a composite cluster or a way to parcel the 20 down into just a couple variables that are the most telling? I don't what to over fit the model, since I know the confidence intervals will easily get blown out of control.


    Thanks.
    Stop cowardice, ban guns!

  2. #2
    TS Contributor
    Points: 22,473, Level: 93
    Level completed: 13%, Points required for next Level: 877
    spunky's Avatar
    Location
    vancouver, canada
    Posts
    2,137
    Thanks
    166
    Thanked 538 Times in 432 Posts

    Re: Item Response Question

    If you're interested in reducing the dimension of your explanatory variables (20 IVs) then Principal Component regression (based off Principal Component Analysis) would be a better choice. That is unless you have some reason to believe the 20IVs are manifest variables relating some type of latent factor.

    Remember, Factor Analysis assumes a statistical model that has a different purpose from Principal Components and, from the way you describe the problem, it seems like PCA is what you want.

    I have not heard before about Principal Component regression within the context of logistic regression but it seems like a common-enough problem that someone surely has come up with something somewhere.
    for all your psychometric needs! https://psychometroscar.wordpress.com/about/

  3. #3
    Omega Contributor
    Points: 38,432, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,006
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: Item Response Question

    Item responses are definitely correlated. The items fall into 5 categorical themes already. Let me know what you think about the following. I was asked to find out which variables are related to the binary outcome, well most of them are, so I am planning to just run 5 stepwise regressions, one for each of the categories and tell it just to keep the best predictor. I was going to use this to then just report via the 5 final bivariate models, the best predictor for each category.


    I will divide my level of significance by 25, to address FDR. What should I use in my stepwise as the criteria for selection (inclusion, I am thinking accuracy (c-statistic)?


    This seems slightly less like a general fish excursion.
    Stop cowardice, ban guns!

  4. #4
    Points: 150, Level: 2
    Level completed: 50%, Points required for next Level: 50

    Posts
    8
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Item Response Question

    Quote Originally Posted by spunky View Post
    If you're interested in reducing the dimension of your explanatory variables (20 IVs) then Principal Component regression (based off Principal Component Analysis) would be a better choice. That is unless you have some reason to believe the 20IVs are manifest variables relating some type of latent factor.

    Remember, Factor Analysis assumes a statistical model that has a different purpose from Principal Components and, from the way you describe the problem, it seems like PCA is what you want.

    I have not heard before about Principal Component regression within the context of logistic regression but it seems like a common-enough problem that someone surely has come up with something somewhere.
    agree.. offering a batter choice

  5. #5
    Points: 134, Level: 2
    Level completed: 68%, Points required for next Level: 16

    Posts
    7
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Item Response Question

    Quote Originally Posted by spunky View Post
    If you're interested in reducing the dimension of your explanatory variables (20 IVs) then Principal Component regression (based off Principal Component Analysis) would be a better choice. That is unless you have some reason to believe the 20IVs are manifest variables relating some type of latent factor.

    Remember, Factor Analysis assumes a statistical model that has a different purpose from Principal Components and, from the way you describe the problem, it seems like PCA is what you want.

    I have not heard before about Principal Component regression within the context of logistic regression but it seems like a common-enough problem that someone surely has come up with something somewhere.
    i think the only choice..

  6. #6
    Points: 424, Level: 8
    Level completed: 48%, Points required for next Level: 26

    Location
    Oslo, Norway
    Posts
    14
    Thanks
    11
    Thanked 2 Times in 2 Posts

    Re: Item Response Question


    You could also test your IVs using ReLogit (Rare Events Logit) - there is a package for Stata, haven't checked for R or SAS.

    Logistic Regression in Rare Events Data (King and Zeng, 2001)
    "On a long enough timeline, the survival rate for everyone drops to zero"

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats