The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

How to remove negation from tweets and replace abbreviations with my original?

ghamgham Member Posts: 24 Learner III
edited December 2018 in Help

hi

How to remove negation from tweets and replace abbreviations with my original?

Tagged:

Answers

  • Telcontar120Telcontar120 RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn

    I am not totally clear about what you mean by "removing negation" from tweets.  Do you simply want to eliminate negative words like (no, not, never, etc.) from your analysis?

    If so, one way would be to process your tweets as text, tokenizing by non-letters (to get individual words), and then create a custom stopword dictionary for negative words and use the Stopword (Dictionary) operator to remove them.  You can also use Replace Tokens for any abbreviations that you want to expand to the full word.

     

     

    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts
  • khazankhazan Member Posts: 23 Learner III

    I also have this problem

    I want to delete negatives from the words of a sentence to analyze feelings. And I can replace abbreviations with the original words
    But
    I do not know what operators and how to use them?
    How do I use stop word dectionary and what dictionary do I have? Where to download?
    Please help me dear engineer

  • ghamgham Member Posts: 24 Learner III

    I want to remove the negations from the words of a sentence to analyze emotions. And I want to replace the abbreviations with the original words
    But
    I do not know which operators and how to use them?
    How can I use the dictionary stop word and what dictionary should I find? Where to download?
    Please help my dear engineers

  • ghamgham Member Posts: 24 Learner III

    Hello

    I've done some preprocessing.
    Only delete the words negate and replace abbreviated words with the original words that do not know how to do it
    I beg your pardon, I'm sorry
    Thankful
    ?

  • ghamgham Member Posts: 24 Learner III

    Please help my friend help me out.

  • Thomas_OttThomas_Ott RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,761 Unicorn

    @gham @khazan If you want to alert someone to your post, I suggest using the '@' symbol and their name, like @Telcontar120. Threads get buried after a while.

     

    With respect to remicing negative words, how is this good if you're trying to understand emotion/sentiment? To turn words into abbreviations or something else, you can use the Replace Token operator or Replace operator.

     

    Also, it' always best to post your XML process, community members have a hard time guessing what some posters are thinking. 

  • ghamgham Member Posts: 24 Learner III

    Hello
    Do you have a dictionary to remove stops word and steeming or remove negation? Do i download

  • sgenzersgenzer Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager

    hello @gham I am sorry to say this but I am starting to issue temporary bans to users who cannot understand the protocol on how to ask questions on the community. In order to ask a question like this, you MUST post your process XML at the least. There are instructions on how to do this in many, many places including here: https://youtu.be/KkgB5QXWXJ8, and the enormous "Read Before Posting" banner on right when you post/reply to any message.

     

    Please post your XML so we can help you better.

     

    Respectfully,

     

Sign In or Register to comment.