+ Reply to Thread
Results 1 to 3 of 3

Thread: ROC curve analysis - Implications of unequal no. of observations in each group

  1. #1
    Points: 52, Level: 1
    Level completed: 4%, Points required for next Level: 48

    Posts
    2
    Thanks
    1
    Thanked 0 Times in 0 Posts

    ROC curve analysis - Implications of unequal no. of observations in each group




    Hi,

    I'm using ROC curve analysis to identify thresholds for accelerometer (activity monitor) raw count data in order to classify count data as physical activity intensity (e.g. a count value of >600 would indicate moderate activity etc.).

    Because of methodological limitations I have 18 observations for light activity and 30 observations for moderate activity. I plotted an ROC curve, and developed a threshold and accompanying sensitivity, specificity and AUC values. I'm sure that there is some implication of having an unequal number of observations in each group on the sensitivity, specificity and AUC values (i.e. if there were equal numbers in each group the values would be higher/lower) but am not sure what the implication is and why.

    I'd appreciate anyone's thoughts on this matter. Thanks in advance.

  2. #2
    Omega Contributor
    Points: 38,396, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    7,001
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: ROC curve analysis - Implications of unequal no. of observations in each group

    I believe it may be more appropriate for you to say you have continuous data from accelerometers, not count data. Count data has a specific meaning. Please correct me if I am wrong about your data.

    Also what is your gold standard, that is not clear. You are taking your accelerometer data and saying if it is >600 vigorous and lower than that, moderate. How do you test whether the activity really is moderate or vigorous? Also what is the true prevalence of moderate and vigorous exercise in your sample based on the gold standard?

    Once you answer these questions it should be easy to address your concern. Which I am guessing will not be an issue.
    Stop cowardice, ban guns!

  3. The Following User Says Thank You to hlsmith For This Useful Post:

    ryanj8 (08-15-2013)

  4. #3
    Points: 52, Level: 1
    Level completed: 4%, Points required for next Level: 48

    Posts
    2
    Thanks
    1
    Thanked 0 Times in 0 Posts

    Re: ROC curve analysis - Implications of unequal no. of observations in each group


    Thanks for your reply. You are right to say that I have continuous data from accelerometers. The unit of the data is counts per minute. Apologies for the lack of clarity.

    The gold standard is oxygen consumption (VO2) (measured with an indirect calorimeter). Based on the gold standard I have 18 bouts of light activity and 30 bouts of moderate activity.

    Based on the threshold derived from ROC analysis I have 26 true positives and 4 false negatives. And 15 true negatives and 3 false positives.
    Last edited by ryanj8; 08-15-2013 at 04:23 AM.

+ Reply to Thread

           




Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats