+ Reply to Thread
Results 1 to 14 of 14

Thread: Why aren't my results significant?

  1. #1
    Points: 1,831, Level: 25
    Level completed: 31%, Points required for next Level: 69

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Why aren't my results significant?



    I'm carrying out an n-way Anova in SPSS. The dependent variable is salary and one of the independent variables is level of English. The Anova is telling me the sig. level is 0.94, i.e. not significant, yet the means are as follows -
    None - 36.30
    Basic - 46.67
    Intermediate - 33.30
    Advanced - 83.00

    How can the differences possibly not be significant when the Advanced mean is double that of other groups? Sorry if I'm being thick, and thank you for any help!

  2. #2
    TS Contributor
    Points: 5,172, Level: 46
    Level completed: 11%, Points required for next Level: 178

    Location
    Athens , Greece
    Posts
    330
    Thanks
    0
    Thanked 4 Times in 2 Posts
    Check the standard error too. It's the second part that determines significance!

    [FONT=Fixedsys]

    Visit : [/FONT][URL="http://www.statsravingmad.com/"]Site[/URL]|[URL="http://www.statsravingmad.com/blog"]Stats Blog[/URL]|[URL="http://parzakonis.info/"]Personal mini-site[/URL]

    [FONT=Fixedsys]Contact : [/FONT][URL="http://www.statsravingmad.com/contact/"]Contact[/URL]

  3. #3
    Points: 1,831, Level: 25
    Level completed: 31%, Points required for next Level: 69

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts
    I'm sorry, I don't understand. Could you explain what you mean in really simple terms (i.e. for someone who isn't that bright!)? I can't see anything in my output that says standard error. I'm using SPSS by the way - did I need to select a post hoc test or something else before running the Anova? Also, how would I present the standard error statistic in my results? Thank you!

  4. #4
    TS Contributor
    Points: 5,172, Level: 46
    Level completed: 11%, Points required for next Level: 178

    Location
    Athens , Greece
    Posts
    330
    Thanks
    0
    Thanked 4 Times in 2 Posts
    Ok.

    q1. What is the Levene Stat. Is it <0.05?
    q2. Maybe, it's the case that the "Robust Tests of Equality of Means" are more appropriate.

    [FONT=Fixedsys]

    Visit : [/FONT][URL="http://www.statsravingmad.com/"]Site[/URL]|[URL="http://www.statsravingmad.com/blog"]Stats Blog[/URL]|[URL="http://parzakonis.info/"]Personal mini-site[/URL]

    [FONT=Fixedsys]Contact : [/FONT][URL="http://www.statsravingmad.com/contact/"]Contact[/URL]

  5. #5
    Points: 1,831, Level: 25
    Level completed: 31%, Points required for next Level: 69

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Levene's test came out at greater than 0.05. Would this affect the significance level? I don't know what you mean by Robust Test of Equality of Means - do you mean the Brown-Forsythe/Welch tests? Sorry again!

  6. #6
    TS Contributor
    Points: 5,172, Level: 46
    Level completed: 11%, Points required for next Level: 178

    Location
    Athens , Greece
    Posts
    330
    Thanks
    0
    Thanked 4 Times in 2 Posts
    Quote Originally Posted by minnie2 View Post
    I don't know what you mean by Robust Test of Equality of Means - do you mean the Brown-Forsythe/Welch tests? Sorry again!
    Yes, that's what I mean. What is their significance?
    [FONT=Fixedsys]

    Visit : [/FONT][URL="http://www.statsravingmad.com/"]Site[/URL]|[URL="http://www.statsravingmad.com/blog"]Stats Blog[/URL]|[URL="http://parzakonis.info/"]Personal mini-site[/URL]

    [FONT=Fixedsys]Contact : [/FONT][URL="http://www.statsravingmad.com/contact/"]Contact[/URL]

  7. #7
    Points: 1,831, Level: 25
    Level completed: 31%, Points required for next Level: 69

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts
    I've tried a non-parametric test & Spearman's Rho for the same data and it's still coming out as not significant. Surely it can't be right, looking at the difference in means?

  8. #8
    Points: 1,831, Level: 25
    Level completed: 31%, Points required for next Level: 69

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Oops sorry, crossed post. The significance is 2.58/2.57 respectively.

  9. #9
    TS Contributor
    Points: 5,172, Level: 46
    Level completed: 11%, Points required for next Level: 178

    Location
    Athens , Greece
    Posts
    330
    Thanks
    0
    Thanked 4 Times in 2 Posts
    Quote Originally Posted by minnie2 View Post
    Oops sorry, crossed post. The significance is 2.58/2.57 respectively.
    Do, you mean 0.258/0.257?
    [FONT=Fixedsys]

    Visit : [/FONT][URL="http://www.statsravingmad.com/"]Site[/URL]|[URL="http://www.statsravingmad.com/blog"]Stats Blog[/URL]|[URL="http://parzakonis.info/"]Personal mini-site[/URL]

    [FONT=Fixedsys]Contact : [/FONT][URL="http://www.statsravingmad.com/contact/"]Contact[/URL]

  10. #10
    Points: 1,831, Level: 25
    Level completed: 31%, Points required for next Level: 69

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Yes, apologies

  11. #11
    Points: 2,020, Level: 27
    Level completed: 14%, Points required for next Level: 130

    Location
    Leeds, UK
    Posts
    50
    Thanks
    4
    Thanked 0 Times in 0 Posts
    What is the variance of each group ?

  12. #12
    Points: 1,831, Level: 25
    Level completed: 31%, Points required for next Level: 69

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Hi, the variance between groups is as follows -
    none - 2311.063
    basic - 2635.264
    intermediate - 917.379
    advanced - 7294.500

    So a considerable difference. Would the high degree of variance in the 'advanced' group be the cause of the fact the differences in means are not significant? Sorry if that doesn't make much sense!

  13. #13
    Points: 1,831, Level: 25
    Level completed: 31%, Points required for next Level: 69

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Sorry, I mean the variance *within* each group, not between.

  14. #14
    Points: 2,020, Level: 27
    Level completed: 14%, Points required for next Level: 130

    Location
    Leeds, UK
    Posts
    50
    Thanks
    4
    Thanked 0 Times in 0 Posts

    That's part the problem. You can see graphically in the attachment.

    You said the dependent variable is salary. It cannot take negative values. Note that a non trivial portion of all those normal curves falls below zero. Your data are not normally distributed. You need to think again about your model. Start will plots of the data themselves and see what they look like. Perhaps take logs and look again.
    Attached Images  

+ Reply to Thread

Similar Threads

  1. Replies: 6
    Last Post: 08-15-2010, 06:03 AM
  2. Replies: 0
    Last Post: 08-14-2010, 01:12 PM
  3. Replies: 4
    Last Post: 05-06-2010, 08:00 PM
  4. Replies: 2
    Last Post: 09-07-2009, 01:40 AM
  5. Are my results significant?
    By helenwilliams in forum Statistics
    Replies: 4
    Last Post: 05-05-2008, 06:10 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts








Advertise on Talk Stats