The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

"Text Mining - Basic Question"

ssk1974ssk1974 Member Posts: 11 Contributor II
edited June 2019 in Help
Hi,

I have 42 text files, each text file is a chapter from a novel. I am trying to visualize frequently occurring words in each chapter. How to approach this?

Also what other interesting problems I can solve with that dataset.

Thank you for the time and help.
Tagged:

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    Hello ssk,

    you would simply read the files using a Read Document operator and then process it. In the end it's about the tokenize operator which counts the number of words.

    My friend and colleagure Marius pointed me to this tutorial for text mining: http://vancouverdata.blogspot.de/2010/11/text-analytics-with-rapidminer-loading.html this should really help you.

    If you have further questions, just post them here :)

    Best,

    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • ssk1974ssk1974 Member Posts: 11 Contributor II
    Hi Martin,

    Thank you for the help.

    I have another question, I want to create a word cloud and show the frequently used word in it. How can I do that. The list of words from my 4 set of documents has 10,000 words in it.

    Thank you for the time and help.
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    you mean some word cloud where the size of the word represents the frequency?

    If so,  I am not aware of any built in functionality. I guess it can be done using some javascript api.
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    I did a quick google search

    I think it's easy to use this https://github.com/jasondavies/d3-cloud on rm sever.. Is this what you ment?
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • ssk1974ssk1974 Member Posts: 11 Contributor II
    Thanks Martin, I needed to upload a file and tagcrowd.com, let me do that.
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    I've never used this webpage. Can't you just save your words as a tsv and upload it? Or should it be done automatically?
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
Sign In or Register to comment.