The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

"sensitivity/specificity of confusion matrix vs ROC curve"

sozekessozekes Member Posts: 1 Learner III
edited June 2019 in Help
Hi,
We used 10-fold cross validation to classify 55 patients as responders(R)/nonresponders(NR).
Using Neural Network, Rapid classified the data set with 86.67% accuracy, generated 0.933 sensitivity and 0.8 specificity, according to the confusion matrix as seen in figure below.
Rapid also plotted the ROC curve after classification.

The intersection point of sensitivity(TP rate) and 1-specificity(FP rate) is supposed to be 0.933 to 0.2 on the ROC curve (pointed with a green dot on the curve).

But as you can see the red curve gives 0.85 sensitivity for the 0.2 (1-specificity) value (blue dot).

As far as we know the sensitivity-specificity values ratio must be coherent with the ROC curve.
Could you please let us know what you are thinking about this.

Thanks in advance

image
Tagged:

Answers

  • landland RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 2,531 Unicorn
    Hi,

    what happens if you switch to another way of estimating the AUC? You selected optimistic...

    Greetings,
    Sebastian
Sign In or Register to comment.