+ Reply to Thread
Results 1 to 1 of 1

Thread: comparing test results obtained on the basis of different sample sizes

Hybrid View

  1. #1
    Points: 3,373, Level: 36
    Level completed: 16%, Points required for next Level: 127

    Posts
    23
    Thanks
    3
    Thanked 1 Time in 1 Post

    comparing test results obtained on the basis of different sample sizes

    I have variables a1 and a2 with 57 observations each, and variables b1 and b2 with 29 observations each.

    I compare a1 with a2 by means of a paired-samples t-test, this gives p<0.001. Next, I compare b1 with b2 by means of a paired-samples t-test, this gives p>0.05 (actually p>0.10).

    I compared the p-values, and concluded that I do find a significant effect for the larger set of 57 observations, and do not find a significant effect for the smaller set of 29 observations.

    I am happy with that result, but got the criticism that the p-value of the first t-test cannot be compared to the one of the second test, because of the different sample sizes (57 versus 29).

    What solution would you recommend to solve this problem?
    Last edited by Wilbert; 06-26-2017 at 09:25 AM.

+ Reply to Thread

           




Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats