The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

How can I handle missing values for only specific years so I can keep certain examples?

N_28N_28 Member Posts: 9 Learner I
in Help
Dear all,
Currently, I am writing my master thesis. I am trying to make a predictive model; however, I am really stuck. I just do not know anymore how to handle the missing values in the exampleset without removing valuable examples from my data. To give you a better idea of how my data looks like and what I mean, I have attached a small part of my dataset. 

For example, row 122, is not useful in my opinion as only data on 2017 and 2019 is present. But, row 226 e.g only has 2019 missing. So, I thought maybe I can just delete the rows such as 122 when not sufficient data is available (only two years) but keep a row such as 226 as only one year (2019) is missing. So that I can keep the indicator G3. Is that possible?

Hence, I want to filter out any example that is missing at least X values between 2014- and 2019. But I do not know how to do this and which operator I need for this? 

Can anyone please help me out ? 

Thank you so much in advance.


Best Answers

  • yyhuangyyhuang Administrator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 364 RM Data Scientist
    Solution Accepted
    You can generate indicators for missing value by year. Then sum up the indicators for the total counts of missing columns.

    I don't have your data but get something similar for your reference. HTH!


  • N_28N_28 Member Posts: 9 Learner I
    Solution Accepted
    Thank you so much, I think this is a great idea! I will try this tomorrow.

Answers

Sign In or Register to comment.