+ Reply to Thread
Page 1 of 3 1 2 3 LastLast
Results 1 to 15 of 37

Thread: Please help? Complete novice

  1. #1
    Points: 63, Level: 1
    Level completed: 26%, Points required for next Level: 37

    Posts
    8
    Thanks
    5
    Thanked 0 Times in 0 Posts

    Please help? Complete novice




    Please can someone help me with my analysis of data in my Masters dissertation?

    I have conducted a quantitative self-questionnaire in my organisation, distributed to 12-branch managers & 18-sales managers using an identical questionnaire to gain an internal perception and external perception of competitive strategy. I now have 2 groups of data from the same questions with varying mean scores. How do i analyse the significance between groups? Is this data paired or independent? I'm a complete novice to stats and find the info on the NET very confusing.

    Any help guys be greatly appreciated

    Thanks Lee

  2. #2
    Omega Contributor
    Points: 38,413, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,004
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: Please help? Complete novice

    So you have mean scores for two groups (branch and sales managers). You will likely perform either a t-test (non-paired data) or a Wilcoxon Ranked Sums (nonparametric test). Read up about both and see which may be a better fit.

  3. The Following User Says Thank You to hlsmith For This Useful Post:

    Leehud74 (08-10-2012)

  4. #3
    Points: 63, Level: 1
    Level completed: 26%, Points required for next Level: 37

    Posts
    8
    Thanks
    5
    Thanked 0 Times in 0 Posts

    Re: Please help? Complete novice

    Thank you for your help and speecy response, my main problem was understanding if my data is independent or not, considering my data is gathered from the same organisation. I will look at both you suggested thanks again,

  5. #4
    Points: 63, Level: 1
    Level completed: 26%, Points required for next Level: 37

    Posts
    8
    Thanks
    5
    Thanked 0 Times in 0 Posts

    Re: Please help? Complete novice

    I have decided to use a two-tailed t-test and the result is a p value of 0.25 which i assume i can now state that the null hypothesis is accepted and not statistically signficant, does that sound right? Also can anyone advise if i break my questionnaire down by the 6 different sections i have in my findings should i calculate the p value for each section or leave it as an overall total value?

  6. #5
    Pirate
    Points: 15,159, Level: 79
    Level completed: 62%, Points required for next Level: 191
    victorxstc's Avatar
    Posts
    875
    Thanks
    229
    Thanked 332 Times in 297 Posts

    Re: Please help? Complete novice

    Quote Originally Posted by hlsmith View Post
    So you have mean scores for two groups (branch and sales managers). You will likely perform either a t-test (non-paired data) or a Wilcoxon Ranked Sums (nonparametric test). Read up about both and see which may be a better fit.
    Shouldn't he use "Mann-Whitney U" instead of Wilcoxon? I think Wilcoxon is for paired data.

  7. #6
    Pirate
    Points: 15,159, Level: 79
    Level completed: 62%, Points required for next Level: 191
    victorxstc's Avatar
    Posts
    875
    Thanks
    229
    Thanked 332 Times in 297 Posts

    Re: Please help? Complete novice

    Quote Originally Posted by Leehud74 View Post
    I have decided to use a two-tailed t-test and the result is a p value of 0.25 which i assume i can now state that the null hypothesis is accepted and not statistically signficant, does that sound right? Also can anyone advise if i break my questionnaire down by the 6 different sections i have in my findings should i calculate the p value for each section or leave it as an overall total value?
    Please note that before "accepting" a null hypothesis due to P > 0.05, you should first check your test power. So you have to do power calculations in order to prove your non-significant P value valid and reliable. Otherwise, your P value is questionable.

  8. #7
    Points: 63, Level: 1
    Level completed: 26%, Points required for next Level: 37

    Posts
    8
    Thanks
    5
    Thanked 0 Times in 0 Posts

    Re: Please help? Complete novice

    Now you've lost me sorry? Maybe im trying to over complicate my study, i have a simple questionnaire only 6 sections containing 5 questions each, the number of respondents is only 30 employees but 2 different groups of people. All i want to do is analysis the different opinions by mean score. Do i need to break it down by section and use t-test and power analysis to signfy a difference in my findings between the 2 groups? Sorry if im being simple here but this is all very new to me.

  9. #8
    Fortran must die
    Points: 58,790, Level: 100
    Level completed: 0%, Points required for next Level: 0
    noetsi's Avatar
    Posts
    6,532
    Thanks
    692
    Thanked 915 Times in 874 Posts

    Re: Please help? Complete novice

    A couple of points. First if your p is signficant you reject whatever null you created. What victorstc was pointing out if that if p is not signficant (most commonly this means p is greater than .05) you don't automatically assume that not rejecting the null is correct. You can only do this if the power of your test is high enough typically .8. You know if power is adequate by going to something like Gpower and doing a power test.

    The answer to your question depends on what you are trying to do. If you are trying to show the two groups are signficantly different then you need to do a statistical test. Which test you do depends on your data. The first question you ask is if the two groups are made up of the same people (tested at different points of time) in which case you do a paired test, of whether the two groups are made up of different people in which case you do an indpendent t test (or non-parametric one, see below).

    The second question is if you can calculate a mean from your questions. If you can, you do either a paired t test if your two samples are made up of the same exact people or a independent t test if they are different people. If you can not calculate a mean from your data, or if your data is badly non-normal you do a non-parametric test. The real problem here is that most survey question are ordinal (say, "How satisfied are you" with the response being a five point scale from most satisfied to least satisfied). Whether it is legitimate to create a mean here is hotly debated, but commonly done.

    I will let wiser people tell you what to use if you can't calculate a mean.
    "Very few theories have been abandoned because they were found to be invalid on the basis of empirical evidence...." Spanos, 1995

  10. #9
    Points: 63, Level: 1
    Level completed: 26%, Points required for next Level: 37

    Posts
    8
    Thanks
    5
    Thanked 0 Times in 0 Posts

    Re: Please help? Complete novice

    Thanks noetsi, i have established my groups are independent so unpaired, and using two-tailed t-test i now have a p value of 0.25. I will look at Gpower and do a power test and see what results i get.
    How would i present my findings if i broke my findings down by questionnaire section? Would i calculate the mean score for that group of answers? The t-test will tell me overall if there is a statistical signficance but How do i explain the variance by section or by each answer?

  11. #10
    Fortran must die
    Points: 58,790, Level: 100
    Level completed: 0%, Points required for next Level: 0
    noetsi's Avatar
    Posts
    6,532
    Thanks
    692
    Thanked 915 Times in 874 Posts

    Re: Please help? Complete novice

    With 30 cases your power won't be high in all liklihood. And that is important, because while .25 would cause you not to reject the null it may be insignficant because you have too few cases and thus low power.

    The answer to your question depends on who your audience is, and your own views of the data. If they are academics then you want to ground it more in the pertinant theory, both statistical and whatever topic your research is on. And you want to address more the limits we talked above about. If its a manager than you want to make it far simpler statistically and dwell less on the limits as long as you are satisfied with the results. Let me know what audience you are presenting to and I will make more suggestions.
    "Very few theories have been abandoned because they were found to be invalid on the basis of empirical evidence...." Spanos, 1995

  12. #11
    Points: 63, Level: 1
    Level completed: 26%, Points required for next Level: 37

    Posts
    8
    Thanks
    5
    Thanked 0 Times in 0 Posts

    Re: Please help? Complete novice

    I will work the power analysis out then and see, my audience is academics as the study is for my masters dissertation. My study is testing our competitive strategy within the orgainsation i work. I believe that there is a signficant difference in opinions on strategy and how effective it is from the perception of managers based in the organisation to sales managers based in the field. My study had tobe confined to a region, instructions from the MD.
    Thank you for yiur help greatly appreciated.

  13. #12
    Fortran must die
    Points: 58,790, Level: 100
    Level completed: 0%, Points required for next Level: 0
    noetsi's Avatar
    Posts
    6,532
    Thanks
    692
    Thanked 915 Times in 874 Posts

    Re: Please help? Complete novice

    I would worry about only 30 cases. Your committe might let you slide since its for a master's, but I would bring this up with your supervising professor. It will be less painful in the defense if he buys off on it.
    "Very few theories have been abandoned because they were found to be invalid on the basis of empirical evidence...." Spanos, 1995

  14. #13
    Points: 63, Level: 1
    Level completed: 26%, Points required for next Level: 37

    Posts
    8
    Thanks
    5
    Thanked 0 Times in 0 Posts

    Re: Please help? Complete novice

    Yeah he is aware i have a secondary source of data too in the form of several structured interviews, he is ok with this.

  15. #14
    Fortran must die
    Points: 58,790, Level: 100
    Level completed: 0%, Points required for next Level: 0
    noetsi's Avatar
    Posts
    6,532
    Thanks
    692
    Thanked 915 Times in 874 Posts

    Re: Please help? Complete novice

    Then you are probably ok. If you don't think he will be anoyed (some professors can be pretty arrogant) you might carefully raise the point of whether other members will be concerned over this. I had the immensely painful experience of my phd professor having no problems with my data, than being roasted by other professors in my defense who had other methodological assumptions. It was my fault for not checking in before hand.

    But they may well be less harsh in a master's work.
    "Very few theories have been abandoned because they were found to be invalid on the basis of empirical evidence...." Spanos, 1995

  16. #15
    Human
    Points: 12,686, Level: 73
    Level completed: 59%, Points required for next Level: 164
    Awards:
    Master Tagger
    GretaGarbo's Avatar
    Posts
    1,363
    Thanks
    455
    Thanked 462 Times in 402 Posts

    Re: Please help? Complete novice


    Silently I say to Leehud74 that I think that Noetsi is making this to complicated. If you would have a department presentation I would suggest presenting the mean for each question for the two departments (12 and 18 persons). With the mean, if you do a graphical presentation, I would include “error bars” for the standard error of the data.

    I would not do an afterwards power calculation. It would be misleading and wrong. (I emphasis doing it afterwards.) So skip that!

    If the 30 persons are all there is then you have investigated the whole population
    And there is no more. There is no sampling problem! However frankly, there will probably remain some measurement error in the answers. I believe that half of the observed standard deviation is measurement error, so I think that presenting the standard error is enough.

    Instead in a presentation and in the masters “thesis” I would suggest presenting subject matter problems, not the statistics. Statistics is interesting but not the whole world.

+ Reply to Thread
Page 1 of 3 1 2 3 LastLast

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats