The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
How to train large number of models?
Learner I
Hi,
I need to train large number of models like 300 models to predict 300 different targets. I thought of using auto model to train these models since training them one by one will take too much time, months if not years in best case. But the problem is as far as I know for every model, I need to use the interface and select inputs and target, and inspect the results which will also take too much time.
Is there any way to automatize the auto model, so that these can be trained by themselves, and the best model is deployed automatically?
The second question is let's say that we managed to train these models and deployed them and after a while I noticed data drift for some models. Is there any way to trigger a retraining process for these models? This retraining must be done by auto model too. We can assume that the latest data is available for training.
I need to train large number of models like 300 models to predict 300 different targets. I thought of using auto model to train these models since training them one by one will take too much time, months if not years in best case. But the problem is as far as I know for every model, I need to use the interface and select inputs and target, and inspect the results which will also take too much time.
Is there any way to automatize the auto model, so that these can be trained by themselves, and the best model is deployed automatically?
The second question is let's say that we managed to train these models and deployed them and after a while I noticed data drift for some models. Is there any way to trigger a retraining process for these models? This retraining must be done by auto model too. We can assume that the latest data is available for training.
1
Best Answer
-
dang
Member Posts: 11 
Contributor II
Have you take a look at the new operator for multi label modeling and its tutorial process? You would have to build multiple models manually from scratch.
https://docs.rapidminer.com/latest/studio/operators/modeling/predictive/ensembles/multi_label_model_learner.html
For your second question, we usually deploy a pre-trained model as web service on AI Hub and monitor model performance over time on a dashboard. On the model leaderboard, you can switch between active models and challenger models.2
