The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

How to connect Rapidminer with a database (ScienceDirect, Scopus etc.)?

RMNewbieRMNewbie Member Posts: 3 Learner I
Hello together. ;)

I'm a total beginner with Rapidminer and I want to use it for my Master-Thesis.
First I would like to describe to you what I want to use Rapidminer for.
Rapidminer is supposed to do a topic modelling for me. The goal is to get a word cloud with the most important topics.
I want to use multiple articles, book chapters etc. from ScienceDirect. I got over 6,000 results in my first search, so it would be impossible to download all of them one by one. Is it possible to create a connection to a database like ScienceDirect?

I hope you can help me. Maybe I'm totally wrong with my approach and Rapidminer won't work like that.

Thank you!

Hannes

Best Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    Solution Accepted
    Hi there,

    ScienceDirect is not a database in the traditional sense. Usual databases like postgres, mysql etc are of course easily connectable.

    The question at hand here is what the services offer as progammable way to interface with them. If they have a way to connect, we can see what we can do and usually there is a way to read it.
    Best,
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • ceaperezceaperez Member Posts: 541 Unicorn
    Solution Accepted
    Hi @RMNewbie,
    What I use to do in this case, is to work with Scopus and export the search results with all the details that I need for my analysis as csv. After that, you can work with RM text processing extenssion to analyze your data.

    best, 

    Cesar

Answers

  • RMNewbieRMNewbie Member Posts: 3 Learner I
    Hey Martin,

    thanks for your answer, it helps me a lot.

    Kind regards,

    Hannes
  • RMNewbieRMNewbie Member Posts: 3 Learner I
    Hey Cesar,

    thanks for the tip, it sounds great! I will give it a try.

    Best,

    Hannes
Sign In or Register to comment.