# Thread: how to prove COV(y bar, estimated beta1) in linear regression equals 0

1. ## how to prove COV(y bar, estimated beta1) in linear regression equals 0

Yi=Xi*beta1 + beta0 + error
Prove:
COV(average of Yi, estimated beta1) = 0

Thanks!

2. Originally Posted by hehe1223
Yi=a*beta1 + beta0 + error
Prove:
COV(average of Yi, estimated beta1) = 0

Thanks!
Is "a" just a constant?

3. Originally Posted by Dragan
Is "a" just a constant?
sorry. typo. I have corrected. :P

4. Originally Posted by hehe1223
sorry. typo. I have corrected. :P
I am sorry to tell you this, but your proposition is not correct.

More specifically, the covariance between between the mean of Y and the estimated regression slope is not zero.

Simply, it is:

Cov(Ybar, b1) = Xbar*Sigma^2 / ∑Xi^2.

5. Originally Posted by Dragan
I am sorry to tell you this, but your proposition is not correct.

More specifically, the covariance between between the mean of Y and the estimated regression slope is not zero.

Simply, it is:

Cov(Ybar, b1) = Xbar*Sigma^2 / ∑Xi^2.
Really? Cannot agree.
I actually figured out a troublesome way (don't think it is the expected way, thus asking here) of doing it and indeed get 0.

Some known and provable facts:
Var(estimated beta1) = sigma^2/Sxx
Cov(estimated beta1, estimated beta0) = -sigma^2*xbar/Sxx (something like what you claimed for Cov(Ybar, b1))

Cov(Ybar, b1') = E(Ybar*b1') - E(Ybar)*E(b1')
=E(xbar*b1' + b0')*b1' -(xbar*b1+b0)*b1
=xbar*E(b1'^2) +E(b1'*b0') -xbar*b1^2-b0*b1
=xbar(Var(b1')+b1^2) + b1*b0 + Cov(b1', b0') - xbar*b1^2 - b0*b1
= ...
=0

What do you think?

6. Originally Posted by hehe1223
Really? Cannot agree.
I actually figured out a troublesome way (don't think it is the expected way, thus asking here) of doing it and indeed get 0.

Some known and provable facts:
Var(estimated beta1) = sigma^2/Sxx
Cov(estimated beta1, estimated beta0) = -sigma^2*xbar/Sxx (something like what you claimed for Cov(Ybar, b1))

Cov(Ybar, b1') = E(Ybar*b1') - E(Ybar)*E(b1')
=E(xbar*b1' + b0')*b1' -(xbar*b1+b0)*b1
=xbar*E(b1'^2) +E(b1'*b0') -xbar*b1^2-b0*b1
=xbar(Var(b1')+b1^2) + b1*b0 + Cov(b1', b0') - xbar*b1^2 - b0*b1
= ...
=0

What do you think?

Have a look at this link. I sketched the proof in my last post.

7. Originally Posted by Dragan
Have a look at this link. I sketched the proof in my last post.

Okay, I think I see what is going on now.

My original assertion (which is true) is for the special case of when the intercept term is zero. I missed that subtle point when I went back and looked at my previous post i.e. the model was specified without an intercept term.

So, yes, in general, I believe it is correct that the covariance should be zero.

I think a quick way to write this would be:

where the first term in the last part would not appear if the intercept term is zero.

8. Originally Posted by Dragan
Okay, I think I see what is going on now.

My original assertion (which is true) is for the special case of when the intercept term is zero. I missed that subtle point when I went back and looked at my previous post i.e. the model was specified without an intercept term.

So, yes, in general, I believe it is correct that the covariance should be zero.

I think a quick way to write this would be:

where the first term in the last part would not appear if the intercept term is zero.
Thank you so much!!
I was wondering for a long time.
Did not expect the intercept makes such a big difference. But it makes sense.
Thanks again.

9. ## how to prove COV(estimated beta0, estimated beta1) in linear regression is equals??

Yi=Xi*beta1 + beta0 + error

Prove:
COV(estimated beta0, estimated beta1) = 0

Thanks!

10. ## Re: how to prove COV(estimated beta0, estimated beta1) in linear regression is equals

Originally Posted by natswim
Yi=Xi*beta1 + beta0 + error

Prove:
COV(estimated beta0, estimated beta1) = 0

Thanks!
Where are you getting the idea from that the covariance between the estimated intercept term and the estimated slope coefficient would --in general-- be zero???

11. ## Re: how to prove COV(estimated beta0, estimated beta1) in linear regression is equals

Originally Posted by Dragan
Where are you getting the idea from that the covariance between the estimated intercept term and the estimated slope coefficient would --in general-- be zero???

I'm so sorry...
I wanna know this:

Yi=Xi*beta1 + beta0 + error

COV(estimated beta0, estimated beta1) is ????

Thanks!

Sorry!!

12. ## Re: how to prove COV(estimated beta0, estimated beta1) in linear regression is equals

Originally Posted by natswim
I'm so sorry...
I wanna know this:

Yi=Xi*beta1 + beta0 + error

COV(estimated beta0, estimated beta1) is ????

Thanks!

Sorry!!

You can find the proof of this in other threads here - I did it not too long ago. This question has come up a few times. It goes like this (I'll be a little neater this time):

where I am making use of

giving

.

14. ## Re: how to prove COV(estimated beta0, estimated beta1) in linear regression is equals

Thanks by the answer. You are brilliant!

15. ## Re: how to prove COV(estimated beta0, estimated beta1) in linear regression is equals

Originally Posted by Dragan
You can find the proof of this in other threads here - I did it not too long ago. This question has come up a few times. It goes like this (I'll be a little neater this time):

where I am making use of

giving

.

Thanks by the answer. You are brilliant!

16. ## Re: how to prove COV(estimated beta0, estimated beta1) in linear regression is equals

Originally Posted by natswim
Thanks by the answer. You are brilliant!
Well, actually, I am not brilliant...this is fairly basic stuff.