+ Reply to Thread
Results 1 to 6 of 6

Thread: testing for improvement over time

  1. #1
    Points: 1,932, Level: 26
    Level completed: 32%, Points required for next Level: 68

    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts

    testing for improvement over time



    A company kept record of contacts and sales during 20 consecutive periods. The results are listed in the file xx. According to these data, can there be shown a significant improvement of the success rate over time? (significance level of 1%)

    How do i test for improvement over time? I believe a t-test isn't applicable here because we're not testing for changes from mean. I believe it has something to do with regression. Could someone give some pointers please?

    The file contains a number of contacts and sales made in each period.
    f.ex.
    Period 1: contacts (120), sales (10)
    Period 2: contacts (122), sales (12)
    ...
    Last edited by JackSwan; 04-19-2011 at 06:36 PM.

  2. #2
    Points: 1,932, Level: 26
    Level completed: 32%, Points required for next Level: 68

    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: testing for improvement over time

    Would it be possible to split them into three or four samples, take the mean of the samples and test with ANOVA (one-tailed F-test) whether there is an increase?
    Another option is to do a regression and check the coefficient and if it's more than 1 then there's an increase over time. Could this be the right solution?
    Last edited by JackSwan; 04-21-2011 at 04:08 PM.

  3. #3
    Super Moderator
    Points: 8,567, Level: 62
    Level completed: 39%, Points required for next Level: 183
    Dragan's Avatar
    Location
    Illinois, US
    Posts
    1,724
    Thanks
    0
    Thanked 127 Times in 113 Posts

    Re: testing for improvement over time

    Quote Originally Posted by JackSwan View Post
    Would it be possible to split them into three or four samples, take the mean of the samples and test with ANOVA (one-tailed F-test) whether there is an increase?
    I think that if you're going to use the means, you might also want to consider testing for Trend (i.e. trend analysis using orthogonal polynomial coefficients).

  4. #4
    Points: 1,932, Level: 26
    Level completed: 32%, Points required for next Level: 68

    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: testing for improvement over time

    Thanks for the answer. This is an intermediary statistics course and we haven't had any trend analysis using orthogonal polynomial coefficients in our lectures so I really don't know what that is but I will check it out.

  5. #5
    FormerlyKnownAsRaptor
    Points: 24,343, Level: 94
    Level completed: 99%, Points required for next Level: 7
    trinker's Avatar
    Location
    Buffalo, NY
    Posts
    3,166
    Thanks
    882
    Thanked 550 Times in 498 Posts

    Re: testing for improvement over time

    I'm just shooting ideas here. Take what looks good and run with it. You haven't given a full picture of the scenerio so...

    A repeated measures analysis could work here but that's a lot of trials. Regression could work but that's getting into territory you said you haven't covered with trend analysis as Dragen suggests. You have appears to be two DV's. You could possibly turn the 2 DVs into a proportion of contacts to sales and put that into a simple regression model.

  6. #6
    Points: 1,932, Level: 26
    Level completed: 32%, Points required for next Level: 68

    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: testing for improvement over time


    Actually this is the full picture of the scenario. After thinking long and hard the answer was actually very simple. First calculate the success rate: sales/contacts
    Then run regression with x= period and y=success rate. From this one can figure out that the coefficient *period is positive and significant at a = 0.01 . Thus, we can reject the null and conclude that there is significant improvement of the success rate over time.

    Thanks to all who contributed

+ Reply to Thread

Similar Threads

  1. Testing for a change in mean in a time series
    By Buchuck in forum Statistical Research
    Replies: 1
    Last Post: 03-05-2011, 08:35 AM
  2. testing for significance between time categories
    By jessisatthebeach in forum Statistics
    Replies: 5
    Last Post: 04-03-2010, 01:57 AM
  3. Replies: 12
    Last Post: 06-17-2009, 10:29 AM
  4. Improvement between pre -> post tests.
    By Craig100 in forum Statistics
    Replies: 0
    Last Post: 03-28-2009, 06:52 AM
  5. Comparing Improvement Between Groups - Best Approach?
    By Barnzilla in forum Statistical Research
    Replies: 3
    Last Post: 01-14-2009, 09:27 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts








Advertise on Talk Stats