The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

"Decision Tree Optimization and Accuracy"

lex_
lex_ Member Posts: 2 image Learner II
edited June 2019 in Help

Hi,

 

I'm trying to use a decision tree which is nested inside the Optimize Parameters (Grid), focusing on Max. Depth and Min. Gain.

 

 

Reconstructing the decision tree using the results obtained above, but without the Optimize Parameters (Grid), the accuracy is lower now.

 

Why is that so?

Tagged:

Best Answer

  • Telcontar120
    Telcontar120 RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 image Unicorn
    Solution Accepted

    If you are using cross-validation without a local random seed set then every time you close and re-open that process in RapidMiner you can get a different result even if you don't make any other changes.  So I suspect that could be the issue.  

     

     

    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts

Answers

  • MartinLiebig
    MartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 image RM Data Scientist

    Hi,

     

    what performances are you comparing? The X-Val performances from within the optimization with an X-Val result from without?


    Are the performances comparable w.r.t their std_devs?


    ~Martin

    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • lex_
    lex_ Member Posts: 2 image Learner II

    Thanks for pointing me to the right direction.

     

    The random seed was the issue, resulting in the data sets being different after the split operator.

Categories