The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Need all the timestamp between two dates.

Himanshu_PantHimanshu_Pant Member Posts: 46 Learner II
edited June 2021 in Help
I have a dataset which consist of timestamp. The timestamp are in a gap of 15 mins. If I have two dates stored into macros ( e.g. first_date, last_date), how can I fetch all the timestamp between two macros? Example:
2020-08-15T02:30:00.000Z
2020-08-15T02:45:00.000Z
2020-08-15T03:00:00.000Z
2020-08-15T03:15:00.000Z
2020-08-15T03:30:00.000Z
2020-08-15T03:45:00.000Z
2020-08-15T04:00:00.000Z
2020-08-15T04:15:00.000Z

lets say first macro i.e. first_date = 2020-08-15T02:30:00.000Z and second macro i.e. last_date = 2020-08-15T03:30:00.000Z. So with these two macro I want  5 timestamp as an output starting from 2020-08-15T02:30:00.000Z  and ending with 2020-08-15T03:30:00.000Z.

Tagged:

Best Answer

  • yyhuangyyhuang Administrator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 364 RM Data Scientist
    Solution Accepted
    Hi @Himanshu_Pant, I did not understand "loop Attributes" in your process and replaced it with loop examples that create new timestamps with 15 min interval. See attached.

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    Hi,
    the operator Create ExampleSet has an option called Date Series. You should be able to create this there.
    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • Himanshu_PantHimanshu_Pant Member Posts: 46 Learner II
    Hi Martin,

    Thanks for the solution. But can we put ExampleSet in a loop (loop attribute)?
  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    I am sorry, I am not sure I understand the question? Do you want to loop over those dates? If yes - Loop Values can do this.
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • Himanshu_PantHimanshu_Pant Member Posts: 46 Learner II
    For example I have 10 time stamps. 
    2019-04-10T18:45:00.000Z
    2019-04-21T17:45:00.000Z
    2019-05-02T17:00:00.000Z
    2019-05-11T10:45:00.000Z
    2019-05-21T13:00:00.000Z
    2019-05-30T05:15:00.000Z
    2019-06-10T07:30:00.000Z
    2019-06-25T01:30:00.000Z
    2019-07-22T04:00:00.000Z
    2019-07-29T04:00:00.000Z
    2019-08-05T04:00:00.000Z

    For each time stamp, I want last 24 hours of data in the gap of 15 mins. So for first time stamp i.e.
    2019-04-10T18:45:00.000Z, the output will be: 
    2019-04-09T18:45:00.000Z
    2019-04-09T19:00:00.000Z
    2019-04-09T19:15:00.000Z
    2019-04-09T19:30:00.000Z
    2019-04-09T19:45:00.000Z
    2019-04-09T20:00:00.000Z
    2019-04-09T20:15:00.000Z
    2019-04-09T20:30:00.000Z
    2019-04-09T20:45:00.000Z
    2019-04-09T21:00:00.000Z
    2019-04-09T21:15:00.000Z
    2019-04-09T21:30:00.000Z
    2019-04-09T21:45:00.000Z
    2019-04-09T22:00:00.000Z
    2019-04-09T22:15:00.000Z
    2019-04-09T22:30:00.000Z
    2019-04-09T22:45:00.000Z
    2019-04-09T23:00:00.000Z
    2019-04-09T23:15:00.000Z
    2019-04-09T23:30:00.000Z
    2019-04-09T23:45:00.000Z
    2019-04-10T00:00:00.000Z
    2019-04-10T00:15:00.000Z
    2019-04-10T00:30:00.000Z
    2019-04-10T00:45:00.000Z
    2019-04-10T01:00:00.000Z
    2019-04-10T01:15:00.000Z
    2019-04-10T01:30:00.000Z
    2019-04-10T01:45:00.000Z
    2019-04-10T02:00:00.000Z
    2019-04-10T02:15:00.000Z
    2019-04-10T02:30:00.000Z
    2019-04-10T02:45:00.000Z
    2019-04-10T03:00:00.000Z
    2019-04-10T03:15:00.000Z
    2019-04-10T03:30:00.000Z
    2019-04-10T03:45:00.000Z
    2019-04-10T04:00:00.000Z
    2019-04-10T04:15:00.000Z
    2019-04-10T04:30:00.000Z
    2019-04-10T04:45:00.000Z
    2019-04-10T05:00:00.000Z
    2019-04-10T05:15:00.000Z
    2019-04-10T05:30:00.000Z
    2019-04-10T05:45:00.000Z
    2019-04-10T06:00:00.000Z
    2019-04-10T06:15:00.000Z
    2019-04-10T06:30:00.000Z
    2019-04-10T06:45:00.000Z
    2019-04-10T07:00:00.000Z
    2019-04-10T07:15:00.000Z
    2019-04-10T07:30:00.000Z
    2019-04-10T07:45:00.000Z
    2019-04-10T08:00:00.000Z
    2019-04-10T08:15:00.000Z
    2019-04-10T08:30:00.000Z
    2019-04-10T08:45:00.000Z
    2019-04-10T09:00:00.000Z
    2019-04-10T09:15:00.000Z
    2019-04-10T09:30:00.000Z
    2019-04-10T09:45:00.000Z
    2019-04-10T10:00:00.000Z
    2019-04-10T10:15:00.000Z
    2019-04-10T10:30:00.000Z
    2019-04-10T10:45:00.000Z
    2019-04-10T11:00:00.000Z
    2019-04-10T11:15:00.000Z
    2019-04-10T11:30:00.000Z
    2019-04-10T11:45:00.000Z
    2019-04-10T12:00:00.000Z
    2019-04-10T12:15:00.000Z
    2019-04-10T12:30:00.000Z
    2019-04-10T12:45:00.000Z
    2019-04-10T13:00:00.000Z
    2019-04-10T13:15:00.000Z
    2019-04-10T13:30:00.000Z
    2019-04-10T13:45:00.000Z
    2019-04-10T14:00:00.000Z
    2019-04-10T14:15:00.000Z
    2019-04-10T14:30:00.000Z
    2019-04-10T14:45:00.000Z
    2019-04-10T15:00:00.000Z
    2019-04-10T15:15:00.000Z
    2019-04-10T15:30:00.000Z
    2019-04-10T15:45:00.000Z
    2019-04-10T16:00:00.000Z
    2019-04-10T16:15:00.000Z
    2019-04-10T16:30:00.000Z
    2019-04-10T16:45:00.000Z
    2019-04-10T17:00:00.000Z
    2019-04-10T17:15:00.000Z
    2019-04-10T17:30:00.000Z
    2019-04-10T17:45:00.000Z
    2019-04-10T18:00:00.000Z
    2019-04-10T18:15:00.000Z
    2019-04-10T18:30:00.000Z
    2019-04-10T18:45:00.000Z


  • MartinLiebigMartinLiebig Administrator, Moderator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,533 RM Data Scientist
    So you put a loop around the Create Example Set with the start date as a macro?

    Best,
    Martin
    - Sr. Director Data Solutions, Altair RapidMiner -
    Dortmund, Germany
  • Himanshu_PantHimanshu_Pant Member Posts: 46 Learner II
    Well I add a loop attribute to the input data set which consist of these 11 time stamps. Inside loop attribute, I connect a multiply operator. 
    From multiply operator, one connection goes to extract macro which will store the first timestamp. The other goes to adjust date which will adjust the date by one day. This will connect to second macro which will store the previous day. Lets say first date is 2019-04-10T18:45:00.000Z. So the first macro (%{last_date}) will store 2019-04-10T18:45:00.000Z and other macro  (%{first_date}) will store 2019-04-09T18:45:00.000Z. After this, I used equalize time stamps where I selected equalize method: Range, Start value: custom, custome start date: %{first_date} , Stop value: custom, custome stop date: %{last_date} , step size: 15 mins and replace type date time: liner interpolation. 
    However this is giving me an error: Process failed (Text '10/04/2019 18:45:00 PM UTC' could not be parsed).

    Please suggest another method for the problem statement.
  • yyhuangyyhuang Administrator, Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 364 RM Data Scientist
    edited June 2021
    Hi @Himanshu_Pant, 

    It looks the timestamp needs some conversion from the macro according to the error message. If possible, are you able to share the .xml/.rmp file here?

    Cheers,
    YY
  • Himanshu_PantHimanshu_Pant Member Posts: 46 Learner II
    Let me know if any other information is required.
  • Himanshu_PantHimanshu_Pant Member Posts: 46 Learner II
    Hi @mschmitz,

    Kindly help me with this please.
  • Himanshu_PantHimanshu_Pant Member Posts: 46 Learner II
    Hi @yyhuang,

    Thanks a lot for your solution. Please help me in future as well.
Sign In or Register to comment.