The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

loop files in Amazon S3 bucket (reposted)

sgenzer
sgenzer Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 image Community Manager
edited December 2018 in Product Feedback - Resolved
Hi...how do I use the "loop files" operator to loop inside an Amazon S3 folder (which is inside a bucket of course)?

[reposted from December - got no response! :( ]
Tagged:
0
0 votes

Fixed and Released · Last Updated

Comments

  • Marco_Boeck
    Marco_Boeck Administrator, Moderator, Employee-RapidMiner, Member, University Professor Posts: 1,996 image RM Engineering
    Hi,

    There is no out of the box way to loop over S3 files. It should be possible to do it via "Execute Program" which executes AWS commandline tools which then write the file names into a file which is then read and prepared via some other "Loop" operator and fed to a "Read Amazon S3" operator. Unfortunately, there is currently no convenient way.

    Regards,
    Marco
  • sgenzer
    sgenzer Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 image Community Manager
    yeah that's what I was afraid you'd say.  OK.  Feature request?  ;)
  • robin
    robin Member Posts: 100 image Guru

    And just to add to this request, not only being able to loop through data files but to also be able to pull images and their names down from the S3 bucket to feed into decisioning on which images to server on ad platforms. 

  • sgenzer
    sgenzer Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 image Community Manager

    Pushing to Product Ideas.


    Scott

     

  • robin
    robin Member Posts: 100 image Guru

    aws s3 ls s3://bucketname

  • sgenzer
    sgenzer Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 image Community Manager

Categories