Multimethod

Eva Zangerle and me received the Women in RecSys Journal Paper of the Year Award 2023 for our CSUR paper ‘Evaluating Recommender Systems: Survey and Framework’.

Invited talk at the 17th ACM Conference on Recommender Systems (RecSys 2023) as awardee of the Women in RecSys Journal Paper of the Year Award 2023, Senior category.

The comprehensive evaluation of the performance of a recommender system is a complex endeavor: many facets need to be considered in …

When evaluating personalized or adaptive systems, we frequently rely on one single evaluation objective and one single method. This …

Research in the field of information retrieval and recommendation mostly focuses on one single evaluation method and one single quality …

In this paper, we focus on recommendation settings with multiple stakeholders with possibly varying goals and interests, and argue that …

The comprehensive evaluation of the performance of a system is a complex endeavor: many facets need to be considered in configuring an adequate and effective evaluation setting. A single evaluation method or measure is not able to evaluate all relevant aspects in a complex setting where a multitude of stakeholders are involved. Employing a multi-method evaluation, where multiple evaluation methods or measures are combined and integrated, allows for getting a richer picture and prevents blind spots in the evaluation outcome.