The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
loop files in Amazon S3 bucket (reposted)
sgenzer
Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 
Community Manager
Hi...how do I use the "loop files" operator to loop inside an Amazon S3 folder (which is inside a bucket of course)?
[reposted from December - got no response!
]
[reposted from December - got no response!
]
Tagged:
0
Comments
There is no out of the box way to loop over S3 files. It should be possible to do it via "Execute Program" which executes AWS commandline tools which then write the file names into a file which is then read and prepared via some other "Loop" operator and fed to a "Read Amazon S3" operator. Unfortunately, there is currently no convenient way.
Regards,
Marco
And just to add to this request, not only being able to loop through data files but to also be able to pull images and their names down from the S3 bucket to feed into decisioning on which images to server on ad platforms.
Pushing to Product Ideas.
Scott
aws s3 ls s3://bucketname