The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
Problem with Nested Averages
Contributor I
Hi,
I am trying to do repeated cross validation (e.g. 10x10 = 10 CV runs with 10 folds each run) and use the average of all the runs as my performance measure. The problem is that the averages don't seem to be computed correctly.
I've attached the XML for a toy example, using 2x2 cross validation. If you run it and look at the log you'll see that the average of the four individual values is 0.291 (as correctly reported in the mikro average) but the makro average has a different (incorrect) value and it is this value that is reported as the overall performance.
Any help on how to work around this issue would be highly appreciated.
Thanks,
A
[attachment deleted by admin]
I am trying to do repeated cross validation (e.g. 10x10 = 10 CV runs with 10 folds each run) and use the average of all the runs as my performance measure. The problem is that the averages don't seem to be computed correctly.
I've attached the XML for a toy example, using 2x2 cross validation. If you run it and look at the log you'll see that the average of the four individual values is 0.291 (as correctly reported in the mikro average) but the makro average has a different (incorrect) value and it is this value that is reported as the overall performance.
Any help on how to work around this issue would be highly appreciated.
Thanks,
A
[attachment deleted by admin]
0
