The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Sentiment Analysis Vader Normalization of results

LaraNeuLaraNeu Member Posts: 4 Learner I
in Help
Hi RapidMiner Community,

I have a question about the results of my sentiment analysis I conducted for online reviews from Airbnb that I want to compare with ratings given from the reviewers. As a result of the Extract Sentiment operator using Vader I get unstandardized values that I can hardly compare with other values like ratings (am I correct).
In another post in the forum by @mschmitz I found two formulas to normalize the sentiment scores and get results between -1 and +1:
- Sentiment Score/Total tokens
- Sentiment Score/(Total tokens - uncovered toked)

I used both formulas for my data and obviously got two different results. Can someone help me with the interpretation of the results for both formulas? What is the 'right' formula? What is the best way to standardize my data to be able to compare it with the ratings?

Thanks a lot for your help! Really appreciate it!

Tagged:

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    i think there is no real 'correct'. The question is how to normalize the score correctly. I think all three approaches (incl. don't normalize at all) are valid ones.
    Why don't you just calculate the correlation to the stars or a metric like information gain to see whats best?

    ~Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
Sign In or Register to comment.