The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

Weather Enrich Data by Webservice

DocMusherDocMusher Member Posts: 333 Unicorn
edited November 2018 in Help

Hi,

Someone attempted to add weather data related time and geolocation to a dataset with date (time) and location. 

The aim is to analyse the impact of the weather on disease admission to a hospital. 

Which weather related webservice would be best to integrate in a RM process?

Thanks

Sven

Tagged:

Answers

  • Telcontar120Telcontar120 RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,635 Unicorn

    Are you looking for actual weather reports (after the fact) or weather forecasting?

     

    One service that I have used before in RapidMiner is the NOAA service, which delivers all sorts of different kinds of weather data via RSS that can be imported into RapidMiner.  Here's a page showing all the different data feeds: http://www.nws.noaa.gov/rss/

    I've used the National Severe Weather Alerts before and tested a few others as well.

     

     

     

    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts
  • DocMusherDocMusher Member Posts: 333 Unicorn

    Thanks for the reply, its not forecasting I am interested in but historical weather data.

    Thanks

    Sven

  • Thomas_OttThomas_Ott RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,761 Unicorn

    There's a bunch of apis for this. Forecast.io and pywws. I used to use pywws to log my weather station data to the web. They have some open source weather station sites that you can upload to where you might be able to get this info using the Enrich operator: https://pywws.readthedocs.io/en/latest/guides/integration.html#other-services

     

  • ey1ey1 Employee-RapidMiner, RapidMiner Certified Analyst, RapidMiner Certified Expert, RMResearcher, Member Posts: 21 RM Research

    Hi Sven,

     

    You can work with webservices in RapidMiner using the Web Mining extension. There you find the operators "Get Page" and "Enrich Data by Webservices". Both can make API calls and the latter also allows to extract data from response and create new attributes from it.

     

    There are tones of APIs available on the web but considering your initial question, you can create a free account for the weather API of the Weather Channel [1]. You get an API key which can be used to invoke API calls such as for their weather forecast service [2]. They also provide historical data. I am attaching a zip with a sample process for your reference. It uses a small dataset with city names (ioo file also attached). The "Enrich data by Webservices" loops over its examples and stuffs this attribute value in the URL. A little ETL is performed to create the expected URL. The "Get Page" is straight forward. The results can be seen in the attached screenshot (also inside zip file).

     

    Hope this helps.

     

    Best Regards,

    Edwin Yaqub

     

    [1] https://www.wunderground.com/signup?mode=api_signup

    [2] https://www.wunderground.com/weather/api/d/docs?d=data/forecast

Sign In or Register to comment.