The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
Recommendation Evaluation: Precision@k
In prep for my upcoming lecture, it is pretty straightforward how to demonstrate/discuss recommender systems via RM, though it's a bit unintuitive that we have to hand-enter item/user identification, but it's not the end of the world.
Having said that, in browsing the web for examples to provide, I noticed that there are times references to precision@k, but the only metrics that we get back as part of the performance operator are RMSE, MAE, and NMAE.
Is there an operator that is available to do this and I am just missing it, which is often the case on my end.
Having said that, in browsing the web for examples to provide, I noticed that there are times references to precision@k, but the only metrics that we get back as part of the performance operator are RMSE, MAE, and NMAE.
Is there an operator that is available to do this and I am just missing it, which is often the case on my end.
0
Best Answer
-
btibert Member, University Professor Posts: 146 GuruAs is always the case, I was thinking about the problem incorrectly. Obviously this only applies to item-based, and above, I am doing rating-based. My mental model was more in line with what we do for classification or regression metrics, where the items are selectable.
This is a non-issue.1
Answers
Just in case, there is an extension (to install from the marketplace) called "Recommender" dedicated to recommender systems (...logic ).
In this extension, you have especially the operator Performance(Item Recommendation) which allows to calculate the precision@k...
Hope this will help in the future...
Regards,
Lionel