The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

How to execute python operator in radoop nest?

Harshav
Harshav Member Posts: 33 image Learner II
in Help
1.I tried executing with sparkrm ,but it failed .
2.When I tried executing the python operator in radoop nest without using sparkrm (execute python) ,I got output with null values with exact columns that are required.
3.When I use write to csv and connect that ports to execute python , I'm getting perfect results 

But without using write to csv ,How can i execute this execute python operator and get the results? 

Answers

  • MartinLiebig
    MartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 image RM Data Scientist
    edited June 2021
    Hi,
    I strongly advice against doing it. Keep in mind what happens if you run a python script in a SparkRM. There are several JVMs started on different computers of your Spark-Cluster. All of those need the correct environments etc.

    Are there really no ways of doing this with Radoop operators?

    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • Harshav
    Harshav Member Posts: 33 image Learner II
    As I have explained you martin , I used write to csv (radoop operator ) before the execute python operator so that I could get the results( I got results by that method ),but since process is designed in such a way that there are no intermediate tables .Is there any method to convert hive table in radoop nest to be more flexible for python execute operator ,so that it can read and give the desired results.
  • Harshav
    Harshav Member Posts: 33 image Learner II
    @mschmitz ....Can you please just go through the question , there is an emergency regarding this . I kindly request you for solution if there is any 

    Thanks 
    Harsha
  • MartinLiebig
    MartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 image RM Data Scientist
    if this is an emergency, than please use support.rapidminer.com. On support.rapidminer.com we have support level agreements to answer emergencies swiftly.

    On the topic itself, I do not understand the problem, so I cannot really comment on it. Also again, i highly advice against using it at all.

    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany

Categories