How to read/append the data from all the ExampleSet objects under an IOObjectCollection?

RDravid

Hi, At some point in my workflow, I am getting an IOObjectCollection which has several ExampleSet objects. Each ExampleSet (Table data) has several Examples and attributes. and these attributes in each Example are different because of which I am not able to Append/Join the Examples. My ultimate goal is to loop over the data in each ExampleSet and append them and then write the data into a single file (csv or excel). I have tried different loop nodes but only data from the first ExampleSet is being returned. I am not sure how do I append the data from all the ExampleSets under this IOObjectCollection. 

Note: I am a newbie to Rapidminder

varunm1

Hello @RDravid

Did you try using append (superset) operator after loop? This doesn't need the same attributes to append.

Hope this helps. Please inform if you need more information.

tftemme

Hi @RDravid

To add on this the Append (Superset) operator is an operator from the operator toolbox extension which you need to install from the marketplace. There is also the operator 'Merge Attributes' in the extension which merge all attributes of all ExampleSets of a collection to one ExampleSet.

Best regards,
Fabian

Papad

Hi @RDravid
You can also use TurboPrep in order to merge your files.
First load or your files in it and then merge them.
Hope it helps.

Telcontar120

Depending on your data structure, you can also use the conventional Join operator and select the Outer Join if you have something common to all datasets that serves as a join key (such as an ID field).