The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
Skipping comments in CSV loop import
Contributor II
Hi! I experience the following problem:
I am using "Loop Files" and "Read CSV" to import a set of .csv files to RapidMiner.
Each file has roughly the following format:
none1,none2,none3
var1,var2,var3,var4
1,2,3,4
1,2,3,4
I want to skip the first line, so I annotate it as comment, and the second one - as name.
However, although the first line is not present in the output, it seems that the number of columns is equal to its capacity - so, there are 3 columns in the output instead of expected 4. So, this is my problem.
I read that one of the workarounds is naming every required column in dataset metadata information, but here I come across another obstacle: my .csv files have different number of attributes and I don't see any way to create a unified list of columns in metadata information that will fit them all.
Are there any solutions for that? I have not found any, so I will be grateful for your help.
I am using "Loop Files" and "Read CSV" to import a set of .csv files to RapidMiner.
Each file has roughly the following format:
none1,none2,none3
var1,var2,var3,var4
1,2,3,4
1,2,3,4
I want to skip the first line, so I annotate it as comment, and the second one - as name.
However, although the first line is not present in the output, it seems that the number of columns is equal to its capacity - so, there are 3 columns in the output instead of expected 4. So, this is my problem.
I read that one of the workarounds is naming every required column in dataset metadata information, but here I come across another obstacle: my .csv files have different number of attributes and I don't see any way to create a unified list of columns in metadata information that will fit them all.
Are there any solutions for that? I have not found any, so I will be grateful for your help.
Tagged:
0
Answers
unfortunately that is a bug. It is on our list and will be fixed in the future.
Regards,
Marco