+ Reply to Thread
Results 1 to 2 of 2

Thread: Checking stat. significant difference between combined measures of performance

  1. #1
    Points: 4, Level: 1
    Level completed: 7%, Points required for next Level: 46

    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Question Checking stat. significant difference between combined measures of performance




    Hello!

    I wonder how to check is there statistically significant difference between my combined measures of performance of diagnosis methods. But let me describe the problem.

    We have roughly 1000 patients in a sample. All of them have a tumor: benign or malignant.
    For 80% of the sample we can perform a diagnosis of tumor by method A and for 70% (not always the same patients) by method B.
    For each of method we can calculate accuracy, sensitivity and specificity. Now I have my combined measure of performance of method which is x = accuracy*sensitivity*specificity.

    My question is: how can I check whether there is statistically significant difference between x_A and x_B?

  2. #2
    Omega Contributor
    Points: 38,303, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    6,993
    Thanks
    397
    Thanked 1,185 Times in 1,146 Posts

    Re: Checking stat. significant difference between combined measures of performance


    I have not seen this before "combined measure of performance of method which is x = accuracy*sensitivity*specificity".

    Does this combination represent something in particular or is a defined metric?

    So are you asking if the Accuracy*SEN*SPEC for A and B compared differ significantly? What would this matter? Please provide some more details, in that I am interested in what you are doing.

    I think you may have issues comparing the two tests on different samples. Do some have only one test while others have both or just the other one? How was the use of either test or both assigned, randomly or is this observations data?
    Stop cowardice, ban guns!

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats