The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Trigger functionality to trigger rapid miner process after outside process completed

chiragrpatelchiragrpatel Member Posts: 6 Learner II
in Help
Hi Everyone,

I have requirement where I have some outside process (outside of Rapidminer) drop some file on RapidMiner server and as soon as file is dropped, I would like to run my rapidminer process.

From Scheduling tool, we can schedule job based on cron expression, but not based on some kind of file trigger or file watch.

If someone have achieve this functionality in rapidminer and can share the approach that would be much appreciated.

Thanks,
Chirag Patel

Best Answer

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    Hi,
    why cant you just call an exposed WS of RM Server right after you drop it?
    BR,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • chiragrpatelchiragrpatel Member Posts: 6 Learner II
    Thank you Martin for your response.

    We can call WS, but it is rest service (Asynchronous) and our scheduling tool (Tidal Workload Automation) only works in Synchronous fashion.

    The way WS works will not help in this case. WS work in following manner.

    We call WS for process --> It gives response right away (scheduled/started running process with processid or something)

    Our expectation is processes running in Synchronous fashion like below.

    We start the process --> Process keep running and keep the connection open until it results in failure or success.

    Thanks,
    Chirag Patel 
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    i know that you are already in contact with my colleague @MarcoBarradas and we work from our professional service side on the solution. I will contribute on this channel.
    But maybe other great experts like @kayman or @Telcontar120 have thoughts here?
    BR,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • chiragrpatelchiragrpatel Member Posts: 6 Learner II
    Yes. You are right Martin and Thank you for following with others. I have also asked @MarcoBarradas and @Sharan_Gadi to help on on this from RapidMiner side.

    Thanks,
    Chirag Patel
  • chiragrpatelchiragrpatel Member Posts: 6 Learner II
    Just FYI... I was able to achieve the trigger watch functionality using python script. Please find attached solution.




  • chiragrpatelchiragrpatel Member Posts: 6 Learner II
    Adding updated sample code as there was tabbing issue in previous file for some code. Some how I am not able to remove attached file, but used TriggerFileFunctionality.rmp file for latest sample code.
Sign In or Register to comment.