The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
Why doesn't Auto-Model use Parameter Optimization for Deep Learning models?
MavenI opened up a process generated by automodel (Deep Learning with AFE) as I wanted to use it as a starting point and I saw that in the Auto FE step and the train step it does not use the Optmize Parameters operator for optimization. Why is that? I had a similar model with SVM and it did use that operator on those steps.
How does the Parameter Optimization on DL H20 models happens after all?
1
Best Answer
-
IngoRM
Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, Community Manager, RMResearcher, Member, University Professor Posts: 1,751 
RM Founder
Yes, indeed. DL is not fast exactly and keep in mind that next to the normal parameters you would also need to optimize network architecture, activation functions etc. We will work on an "Auto Deep Learning" solution which will deal with this specifically but in "normal" Auto Model we made the compromise between speed and decent results (if not optimal).Hope this helps,
Ingo11
Answers
My understanding is the complexity of optimizing deep learning model hyperparamters, it also might suffer from long run times.
Lets see @IngoRM take on this.
Varun
https://www.varunmandalapu.com/
Be Safe. Follow precautions and Maintain Social Distancing