+ Reply to Thread
Results 1 to 8 of 8

Thread: ROC Curve - Assumptions?

  1. #1
    Points: 4,824, Level: 44
    Level completed: 37%, Points required for next Level: 126

    Posts
    41
    Thanks
    19
    Thanked 1 Time in 1 Post

    ROC Curve - Assumptions?




    Hi All,

    I'd like to run a ROC curve analysis and was wondering if there are any statistical assumptions for this test.

    I've looked in a number of books as well as Google and cannot seem to find much at all on this, so am hoping to get your expertise on it.

    Thanks!

  2. #2
    Omega Contributor
    Points: 38,432, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,006
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: ROC Curve - Assumptions?

    Are you using just one predictor in the model, or are you controlling for multiple predictors - say as in a multiple logistic regression?
    Stop cowardice, ban guns!

  3. #3
    Points: 4,824, Level: 44
    Level completed: 37%, Points required for next Level: 126

    Posts
    41
    Thanks
    19
    Thanked 1 Time in 1 Post

    Re: ROC Curve - Assumptions?

    I'm actually not sure, so you may be able to help me answer that question!

    I am using the ROC curve to assess the sensitivity and specificity of three measures, and using a the presence/absence of a diagnosis as the dichotomous variable (i.e., yes/no the participant has a diagnosis).

    Hope that's clear, thanks for your help!

  4. #4
    Omega Contributor
    Points: 38,432, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,006
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: ROC Curve - Assumptions?

    Hmm, have you thought about using a decision tree?
    Stop cowardice, ban guns!

  5. #5
    Points: 4,824, Level: 44
    Level completed: 37%, Points required for next Level: 126

    Posts
    41
    Thanks
    19
    Thanked 1 Time in 1 Post

    Re: ROC Curve - Assumptions?

    I hadn't thought of using that method as I have been advised by my supervisors to conduct a ROC analysis first and see what that comes up with. It seems that the ROC curve is used widely in my area of research and so I think that is why they would like to continue to use it.

    It is strange that I cannot seem to find any information on whether there are any assumptions to conduct this test though!

  6. #6
    Omega Contributor
    Points: 38,432, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,006
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: ROC Curve - Assumptions?

    I think it is just an optimization algorithm, so you can feed any data into it. I will try to look up if there are any assumptions in the morning.

    I recommended the decision tree based on thinking you are trying to create a decision rule based on 3 variable at the same time, correct or not? Look up what it takes to do a power calculation related to ROC curve, that may help with possible assumption or components to keep in mind.
    Stop cowardice, ban guns!

  7. The Following User Says Thank You to hlsmith For This Useful Post:

    bozatron (01-18-2017)

  8. #7
    Points: 4,824, Level: 44
    Level completed: 37%, Points required for next Level: 126

    Posts
    41
    Thanks
    19
    Thanked 1 Time in 1 Post

    Re: ROC Curve - Assumptions?

    Thanks so much for your input, I am continually being amazed at how helpful people on this forum are. Thanks so much.

    Look forward to hearing what you manage to find.

  9. #8
    Omega Contributor
    Points: 38,432, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,006
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: ROC Curve - Assumptions?


    Well, I got busy - so my response will be terse. I was thinking about the ROC curve, and to take a step back, it is just a graph - that is it. So you plot all of the observed operating points (possible SEN vs SPEC) in the sample then connect them creating the empiral ROC curve.


    So do scatterplots or bar graphs have assumptions? Probably just the intuitive basics related to what type of data it can handle. I think when it comes to assumptions, they may come into play related to using the Whitney-Mann test or comparing models. But the ROC Curve itself is just a graph.


    I would highly recommend the book "Analyzing Receiver Operating Characteristic Curves with SAS: by Gonen. It provides a gentle introduction to many ROC Curve concepts including bias, and applying curves to ordinal and survival data. Plus, I think the book is fairly cheap and Gonen seems to be a person who regularly publishes technical papers in this area.


    Take home thoughts, its just a graph and theory and assumptions may come into play downstream when finding a cut-point or making hypotheses related to AUC.
    Stop cowardice, ban guns!

  10. The Following User Says Thank You to hlsmith For This Useful Post:

    bozatron (01-19-2017)

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats