The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
Strangely Large File Sizes for Small Amounts of Data in Example Sets
Contributor I
I have had several files with file sizes in Store outputs that seem very disproportionate - i.e. 125MB for a 233 row, 29 attribute file. Why is this and how do i fix this?
My only solution so far has been the cumbersome step of writing to an Excel (which has to be done locally). Then separately reading that Excel. For the file mentioned previously this brought the file in question from 125MB to 6.5MB.
Is there something with metadata or attribute types to make a change so drastic? Whats the easier way to get these file sizes under control?
My only solution so far has been the cumbersome step of writing to an Excel (which has to be done locally). Then separately reading that Excel. For the file mentioned previously this brought the file in question from 125MB to 6.5MB.
Is there something with metadata or attribute types to make a change so drastic? Whats the easier way to get these file sizes under control?
0
Answers
can you try to use a Remove Unused Values operator before Store? This should do it.
Cheers,
Martin
Dortmund, Germany