The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Random sampling of a large corpus

frankcfrankc Member Posts: 3 Contributor I
edited November 2019 in Help
How can you pick a random sample from a large corpus for files to perform pre-processing and text mining with the text mining extension?  Is there an operator that does that?

Frank
Tagged:

Answers

  • homburghomburg Employee-RapidMiner, Member Posts: 114 RM Data Scientist
    Hi frankc,

    just a quick question. Do you want to read a random set of files or read all files and shuffle a random set of documents?

    Cheers,
    Helge
  • bkrieverbkriever RapidMiner Certified Analyst, Member Posts: 11 Contributor II
    You should be able to use the Sample operator and select "use local random seed" to select a random sample, similar to a non-text data set.
Sign In or Register to comment.