+ Reply to Thread
Results 1 to 11 of 11

Thread: multiple roc predicted probability to find cut off value of combining variables

  1. #1
    Points: 373, Level: 7
    Level completed: 46%, Points required for next Level: 27

    Posts
    11
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Find cut off value of combining variables when combining roc curves




    I have 2 continuous variables for which I have roc curves for an outcome. Now I used binary logistic and predicted probability to get a combined roc with higher area under curve. But the cut off value in terms of the initial 2 variables?. Predicted probability more than 0.032 doesn't mean anything practically . I need to say that if variable a is more than x and variable b is more than y then together it has 90 per cent sensitivity in predicting outcome. How do I get this value of the 2 variables from the new cut off predicted probability I got from binary logistic regression in spss? Kindly help
    Last edited by jm_manipadam; 03-20-2017 at 05:51 AM.

  2. #2
    Points: 373, Level: 7
    Level completed: 46%, Points required for next Level: 27

    Posts
    11
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    Can I use regression equation for this. If so, how in spss

  3. #3
    Omega Contributor
    Points: 39,022, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,069
    Thanks
    402
    Thanked 1,192 Times in 1,153 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    What is the purpose of the model, to have the highest accuracy or sensitivity or specificity or other? And you want to dichotomize both continuous variables?
    Stop cowardice, ban guns!

  4. #4
    Points: 373, Level: 7
    Level completed: 46%, Points required for next Level: 27

    Posts
    11
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    I want to say with the max sensitivity and specificity possible on the roc curve that variable a over a certain value and variable b over a certain measure predicts outcome to happen in the dependant variable. I got the predicted probability value for this max sensitivity and specificity from the combined roc but from that I am not able to get the individual variable values at that particular point on the roc curve. Pls help, can a regression equation get these values from the predicted probability and coefficients

  5. #5
    Omega Contributor
    Points: 39,022, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,069
    Thanks
    402
    Thanked 1,192 Times in 1,153 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    What program are you using? Did the program dichotomize the continuous variables or not? Typically most programs don't do that in logistic regression automatically. Did it kick out an ROC curve? If so, it shouldn't look like a curve anymore, it should consist of three line segments where the curve normally is.
    Stop cowardice, ban guns!

  6. #6
    Points: 373, Level: 7
    Level completed: 46%, Points required for next Level: 27

    Posts
    11
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    Spss 20 was used.Binary logistic regression was done taking both variables as continuous. I did not enter them in the categorical box. The resulting Pred probability which came in the spss 20 data sheet was used to run an roc curve using analyse and roc

  7. #7
    Omega Contributor
    Points: 39,022, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,069
    Thanks
    402
    Thanked 1,192 Times in 1,153 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    And the curves are curves, yes? Well your predictions are likely for one unit increases in the continuous variables. Are the two continuous variables independent of each other?
    Stop cowardice, ban guns!

  8. #8
    Points: 373, Level: 7
    Level completed: 46%, Points required for next Level: 27

    Posts
    11
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    Yes, they are independent of each other.

  9. #9
    Omega Contributor
    Points: 39,022, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,069
    Thanks
    402
    Thanked 1,192 Times in 1,153 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    Well you need to determine the optimal cut-offs for both of your continuous variables. If they are truly independent and you want to optimize SEN and SPEC at the same time you may be able to determine the Youden Index for both of them independently then use both cut-offs in the same logistic model.


    I would also try to fit a spline or loess regression to examine the linear relationship between the predictors and the dependent variable, which could influence your decision. you could probably also run Random Forests to see how that procedure likes to split the continuous variables and in which order. Though Random Forests typically use Gini Index not Youden index, so keep that in mind.


    Not sure how approachable the latter procedures may be in SPSS.


    Random forest
    Stop cowardice, ban guns!

  10. #10
    Points: 373, Level: 7
    Level completed: 46%, Points required for next Level: 27

    Posts
    11
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables

    Thank you. I am not used to syntax in spss , I got youden done in medcalc trial version. I guess that is enough for both variables individually rather than combining into one roc. Thanks a many

  11. #11
    Omega Contributor
    Points: 39,022, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,069
    Thanks
    402
    Thanked 1,192 Times in 1,153 Posts

    Re: multiple roc predicted probability to find cut off value of combining variables


    You can join them since some patients will be given positive for deference subgroups ( binary code) 0,0; 0,1; 1,0; 1,1.
    Stop cowardice, ban guns!

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats