The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
How does confidence works in Rapidminer
Contributor II
Hello,
I am doing modeling from rapidminer and everything works good but I am not understanding the confidence and prediction that It generates. I have YES and NO as outcome variable. This is how it looks like,
How does the confidence relates to the prediction? As you can see even with higher percentage of NO confidence it is predicting YES. After 0.42 it starting to predict NO. Isn't it like, if the confidence(NO) is above 0.5 then it should predict NO otherwise YES. What is the threshold value for the confidence to predict YES or NO?
Any help is appreciated. Thanks
I am doing modeling from rapidminer and everything works good but I am not understanding the confidence and prediction that It generates. I have YES and NO as outcome variable. This is how it looks like,
How does the confidence relates to the prediction? As you can see even with higher percentage of NO confidence it is predicting YES. After 0.42 it starting to predict NO. Isn't it like, if the confidence(NO) is above 0.5 then it should predict NO otherwise YES. What is the threshold value for the confidence to predict YES or NO?
Any help is appreciated. Thanks
Tagged:
0
Best Answer
-
BalazsBarany
Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert Posts: 955 
Unicorn
Hi!
Confidence is calculated by the modeling algorithm, depending on how the algorithm works. E. g. in Naive Bayes it's a set likelihoods scaled to 1, in a decision tree the ratio in the final node, etc.
By default the decision threshold is 0.5 but it can be changed with threshold-related operators.
It is your process that changes the default. Can you set a breakpoint after the Apply Model to see its output? Are you seeing this effect in the resulting table? What operators are after Apply Model in the process?
Regards,
Balázs
1
Answers
Thank you for your response. I was able to solve the problem with an Apply Threshold operator. It takes care of the confidence issue by assigning the threshold score for YES and NO class.