The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
Radoop training capabilities
Contributor I
I am waiting for a radoop license and I would like to fully understand its capabilities wrt spark integration.
I know that it allows to train spark models train predictive models in parallel...
What about other rapidminer algorithms? is possible to map a general classifier on a spark cluster and reduce the result using baggin/dagging or whatever?
I know that it allows to train spark models train predictive models in parallel...
What about other rapidminer algorithms? is possible to map a general classifier on a spark cluster and reduce the result using baggin/dagging or whatever?
Tagged:
0
Answers
it is not yet possible to run a usual Rapidminer learner on different nodes. For a lot of algorithms it is simply not possible to be trained in a distributed fashion. If you have a radoop licence you get new additional operators for the spark algorithms which can be used.
However - what is possible is ofc to apply a rapidminer model on hadoop. So you can learn on a sampled data set in memory and apply it in hadoop.
Cheers,
Martin
Dortmund, Germany
that perfectly anwsers my question, thanks for quick anwser