+ Reply to Thread
Results 1 to 7 of 7

Thread: what type of statistical analysis would you apply?

  1. #1
    Points: 612, Level: 12
    Level completed: 24%, Points required for next Level: 38

    Posts
    4
    Thanks
    3
    Thanked 0 Times in 0 Posts

    what type of statistical analysis would you apply?




    I am a teacher. I've done pre and post intervention testing with a group (n=17) of pupils. I also did the same tests with another group (n=17) who had no intervention, they just had business-as-usual teaching.

    Whats the first thing you would do - compare the initial test scores for the two groups using a t-test for two samples (with unknown variances)?

  2. #2
    TS Contributor
    Points: 17,742, Level: 84
    Level completed: 79%, Points required for next Level: 108
    Karabiner's Avatar
    Location
    FC Schalke 04, Germany
    Posts
    2,539
    Thanks
    56
    Thanked 639 Times in 601 Posts

    Re: what type of statistical analysis would you apply?

    Comparing baseline scores is a good idea. With n=34, statistical power will be low, though, therefore a nonsignificant result should not be overinterpreted.

    What to do depends on the particular topic of your research, the nature of the measurements taken, and on your research question.

    With kind regards

    K.

  3. The Following User Says Thank You to Karabiner For This Useful Post:

    galegirly (07-02-2016)

  4. #3
    Points: 612, Level: 12
    Level completed: 24%, Points required for next Level: 38

    Posts
    4
    Thanks
    3
    Thanked 0 Times in 0 Posts

    Re: what type of statistical analysis would you apply?

    Thank you Karabiner. I can offer some more info. The research question - "Does (special kind of story-telling) increase literacy skills more than business-as-usual teaching?"

    The data is from a standardised test. This test is a little different from your usual psychometric, possible test scores run from 0 to 20, the standardised population average is 10. there are a number of domains within the test, I have tested the children on five of these, before and after intervention - so I have 10 data points for each child involved. So what do you think, would you start with the t-test?

  5. #4
    Points: 612, Level: 12
    Level completed: 24%, Points required for next Level: 38

    Posts
    4
    Thanks
    3
    Thanked 0 Times in 0 Posts

    Re: what type of statistical analysis would you apply?

    Help please someone!

  6. #5
    Omega Contributor
    Points: 38,253, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    6,989
    Thanks
    397
    Thanked 1,185 Times in 1,146 Posts

    Re: what type of statistical analysis would you apply?

    You would want make sure the student groups were comparable on covariates of interest, including scores. What was the time gap between the two tests, short enough to solely attribute changes on intervention?
    Stop cowardice, ban guns!

  7. The Following User Says Thank You to hlsmith For This Useful Post:

    galegirly (07-23-2016)

  8. #6
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    Re: what type of statistical analysis would you apply?

    The standard analysis for this situation (pre and post measurements on two groups) would be a repeated measures ANOVA. Your main interest would be the interaction between time and group (i.e., does the intervention group change more than the control group?)

    It's also possible to address the question with a multilevel/mixed model.
    Matt aka CB | twitter.com/matthewmatix

  9. The Following User Says Thank You to CowboyBear For This Useful Post:

    galegirly (07-23-2016)

  10. #7
    Points: 612, Level: 12
    Level completed: 24%, Points required for next Level: 38

    Posts
    4
    Thanks
    3
    Thanked 0 Times in 0 Posts

    Re: what type of statistical analysis would you apply?


    there was a 10 week gap between pre and post intervention, and the control group was tested simultaneously. which of the various t-tests available are appropriate to test the comparability of the two groups? From reading around the topic I think it might be a 2 group comparison with unknown variances - which I can do using excel I think)

+ Reply to Thread

           




Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats