1. ## What to do about violations of assumptions

This is one example of a larger topic

Say you are doing logistic regression and you have influential data points. You can't use robust regression - so what do you use? Non-parametrics?

Does cook's d even work with logistic regression?

2. ## Re: What to do about violations of assumptions

It is easy to test for multicolinearity, but I have found no solution with broad support if you can not gather more data and don't want to combine multiple variables into one [neither are realistic solutions in my analysis].

So how does one deal with MC?

3. ## Re: What to do about violations of assumptions

While I am at it, do the rules of thumb for Cook's D apply to predictor (covariate) values for logistic regression, or are these rules different for logistic and linear regression. So far I have found little on this [what I have found leads me to suspect the rules of thumb are the same for the two approaches].

4. ## Re: What to do about violations of assumptions

IIRC, I think Cook's D is based off the Hat Matrix, which involves only the X's (covariates). In this case, you can run a regular OLS regression with your variables and inspect them as usual.

5. ## The Following User Says Thank You to jamesmartinn For This Useful Post:

noetsi (01-25-2016)

6. ## Re: What to do about violations of assumptions

That makes sense although some comments on logistic regression I read suggested different rules of thumb than I saw for linear regression. This may simply be different authors with their own experiences leading them to different rules...

This is certainly the case with Hosmer and Lemeshow who base their recommendations on their own experience with logistic regression.

7. ## Re: What to do about violations of assumptions

Multicolinearity can be addressed by doing nothing (), dropping a variable, or creating a new variable (e.g, construct based).

8. ## Re: What to do about violations of assumptions

Depending on what your actual goal is multicollinearity isn't really much of an issue...

9. ## Re: What to do about violations of assumptions

Where MC comes up is if you are trying to get the unique impact of a predictor. And commonly I am. The problem with collapsing two variables together is that tells you what the collapsed variables do. Not what the individual variables do by themselves. I was wondering if partial regression plots get at this, but I am guessing not...

I guess you could argue if MC makes it impossible to get at the unique impact of a variable creating solutions really distorts reality.

10. ## Re: What to do about violations of assumptions

You still get at the unique impact of the variables, either through odds ratios or partial R^2, but the standard errors get wonky. You know this.

11. ## Re: What to do about violations of assumptions

But you can't test if those are statistically significant and, at least in my line of work that is pretty important. People care a lot about test of statistical significance. This is true in journals as well, at least in social science ones where few pay attention to specific effect size which is hard to interpret substantively. They want to know if this a real effect, that is statistically significant.

In rarely look at odds ratios for linear regression actually, I use slopes.

 Tweet

#### Posting Permissions

• You may not post new threads
• You may not post replies
• You may not post attachments
• You may not edit your posts