The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

How can I compare my prediction to the original label with the Validation Operator?

GLopesGLopes Member Posts: 3 Learner I
in Help
Hello,

I'm doing a text mining project where I'm classifying text with a given label. I've split my data 70/30 with the Split Validation Operator. 

However, as this video "Finding the right model" on RapidMiner Youtube Page shows, I'm unable to see ofr which documents did my model fail. I can only see the confusion matrix... 

How can I see for each document which ones the model was wrong, as the Cross Validation operator does?

Best regards :)

Answers

  • varunm1varunm1 Member Posts: 1,207 Unicorn
    edited June 2019
    Hello @GLopes

    Did you connect the "exa" of performance operator to the output "res"?

    This will give you example set with original and predicted labels. You can analyze which are correct and wrong.

    If you need more help just share you XML code by copying from (View --> Show Panel --> XML) and pasting here.

    Hope this helps.

    Varun
    Regards,
    Varun
    https://www.varunmandalapu.com/

    Be Safe. Follow precautions and Maintain Social Distancing

  • GLopesGLopes Member Posts: 3 Learner I
    Hello! Thank you so much for helping! I'm completely lost and I've seek the whole Internet for help on RapidMiner. 

    I have the Performance Operator inside the Split validation, so it will only let me connect the "per" and the "exa" to "ave"... 

    Here's the XML:  codeshare.io/UbKVU 
    (too big to post her e:\ )


  • Telcontar120Telcontar120 RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn
    Just output your model via the model port and then use another Apply Model operator to score the data (again) and then you will be able to do the comparison. 
    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts
  • GLopesGLopes Member Posts: 3 Learner I
    so, Telcontar120, inside the Validation, should I not use an Apply and a Performance? I'm confused..

    Sorry it's my first RapidMiner process after the tutorials :\
  • sgenzersgenzer Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager
    hi @GLopes you may find the new Text Mining training resources on the RapidMiner Academy more useful and relevant to your project:

    https://academy.rapidminer.com/courses/text-and-web-mining-with-rapidminer

    Scott

Sign In or Register to comment.