The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

"Data reading from DB in batch"

bvirulkarbvirulkar Member Posts: 5 Contributor II
edited June 2019 in Help
Hi Gurus,

We have functionality to write specified number of rows to database with 'Write' operator. Is there any way to define the same while reading the data from database. Also How does the data is read from database (in batch or completely)? where this data is kept and processed?

Thanks,
Bhushan
Tagged:

Answers

  • MariusHelfMariusHelf RapidMiner Certified Expert, Member Posts: 1,869 Unicorn
    Hi Bhushan,

    the Read Database operator always reads the complete data table (or the query you entered) in one big batch. SQL does not provide a simple means to "batchify" database reading. The data is then stored as a RapidMiner Example Set in memory.

    Best, Marius
Sign In or Register to comment.