"ROC confidence limits"

brianbaker

Does anyone know how to control (toggle on/off) the confidence bands in the ROC curves?

I've copied code that has them into another process and they disappear!!

thanks!

land

Hi,
perhaps you don't have confidence attributes in your data?

Greetings,
  Sebastian

brianbaker

Sebastian,

Thank you for your help!  I checked for that; they are there (in the performance export file).


<com.rapidminer.tools.math.ROCPoint id="246">
                <falsePositives>139.0</falsePositives>
                <truePositives>68.0</truePositives>
                <confidence>0.19407850064775464</confidence>
</com.rapidminer.tools.math.ROCPoint>
 

But, I can't figure out how to turn on the confidence band in the ROC plot.  I'd also like to know exactly what it represents; how, for instance, does it relate to the confidence value in the performance export file, is it the height of the shaded region?  I'd also like to know where this confidence comes from / how computed?


If you have any answers or can point me in the right direction I'd appreciate it!

Thanks!
brian

steffen

I think the question has been answered here:
http://rapid-i.com/rapidforum/index.php/topic,47.0.html

land

Thank you Steffen,
this saved me a lot of either work or inconvenience by pointing Brian on the source code 

Greetings,
  Sebastian

brianbaker

Thanks to you both Sebastian and Steffen!