The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

"Filter minimum occurence of token?"

erocoarerocoar Member Posts: 6 Contributor II
edited June 2019 in Help
Hey,

I am still in the process of setting up my text mining / analyzing process :) Since you can filter your words by minimum characters, maximum characters etc. I had the question of whether you can also filter your document; removing all words/tokens that occur >x times?

Thanks in advance!!  :D
Tagged:

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    Hi erocoar,

    sure. In Process documents is a pruning option. This can be set to absolute.

    ~Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • cc4699cc4699 Member Posts: 6 Contributor I

    Prune method on the "Process Documents" is only filtering the number of document occurrences. How can I filter by "Total Occurrences" ?

     

    Thanks

Sign In or Register to comment.