The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Computantional Grid Integration

radoneradone RapidMiner Certified Expert, Member Posts: 74 Guru
edited June 2019 in Help
In my opinion a very interesting improvement to RM would be an possibility to integrate it with a computational grid platform (e.g. also open-source gridgain, http://www.gridgain.com/). Thus experimenting with 10-fold cross-validation can be 10 times faster.

Answers

  • fischerfischer Member Posts: 439 Maven
    Hi Radone,

    that is true. Currently, we have multi core support in the enterprise edition (http://rapid-i.com/content/view/113/136/lang,en/). This will speed up the cross validation as long as you own enough cores. :-)

    The grid support is a tricky thing, both from the programming point of view and from the user's point of view. You face lots of issues like serialization, deciding what tasks gain from distributing, etc. We will consider it in the future, but currently we are going with local parellelization.



    Best,
    Simon
Sign In or Register to comment.