Multiple Stacking


Hi;
What I would like to do is to have multiple stackings so here is the deal;
I have some base learners in my stacking. As a stacked learner I use a neural network. What I'd like to do is to use several seperate neural networks and have their outputs voted.
So Base Learners --> Different Neural Networks ---> Averaging ---> Output.
I tried adding a "Vote" operator in Stacking's Stacked Learner side, putting Neural Nets in it but I keep having Attribute Name collisions. How can I realise this scheme?
What I want to do is multiple stacking, like taking base learners, giving their output to different neural networks, and taking those neural network outputs, averaging them and taking as the result.
Answers
Hi,
sure. There are I think two ways to do it. A combination of Stacking and Vote or use three Stackings (maybe switch roles), join and use Generate Aggreagtion to average the results.
The vorting one is attached.
~Martin
Dortmund, Germany
Thanks! Just a quick question, do I need to enclose this vote in a Cross-Validation to ensure doing cross validation on this entire ensemble (whole vote)?
What I want to do is to do cross validation on just the outputs of vote, not the inner stackings. I don't want to minimize the RMSE of base learners in stackings, I only want to minimize the RMSE for the vote as suggested in BelKor's Pragmatic Chaos.
Thanks! Just a quick question, do I need to enclose this vote in a Cross-Validation to ensure doing cross validation on this entire ensemble (whole vote)?
What I want to do is to do cross validation on just the outputs of vote, not the inner stackings. I don't want to minimize the RMSE of base learners in stackings, I only want to minimize the RMSE for the vote as suggested in BelKor's Pragmatic Chaos.
x-val is estimating a performance of the method to generate a model. Your method to generate a model includes Stacking and Voting, so everything needs to be in an X-Val.
~Martin
Dortmund, Germany