evaluation

Together with Eva Zangerle and Alan Said, I am Guest Editor for the Special Issue ‘Perspectives on Recommender Systems Evaluation’ in the journal ACM Transactions on Recommender Systems.

PERSPECTIVES 2022: The workshop ‘Perspectives on the Evaluation of Recommender Systems’ is back at RecSys 2022.

Evaluation is a central step when it comes to developing, optimizing, and deploying recommender systems. The PERSPECTIVES 2021 workshop …

Evaluation is a cornerstone in the process of developing and deploying recommender systems. The PERSPECTIVES workshop brought together …

I enjoyed today’s tutorial on multi-method evaluation for adaptive systems at UMAP 2021. The slides are online under the menu point Teaching. Or directly access the slides from here: Tutorial slides

Tutorial on Multi-Method Evaluation of Adaptive Systems at UMAP 2021.

I am happy to announce that we – Eva Zangerle, Alain Said, and me – will co-organize the workshop Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES) at RecSys 2021. Finger crossed that the event can indeed happen in Amsterdam and that many of use can safely participate.

I am looking forward to give a tutorial on Multi-method evaluation of adaptive systems: Why and how? at UMAP 2021. Christine Bauer (2021). Multi-Method Evaluation of Adaptive Systems. 29th Conference on User Modeling, Adaptation and Personalization.

While CHIIR 2020 had to be cancelled due to the current global situation with Covid-19, the paper accompanying the tutorial on multi-method evaluation (that I would have held there) is published.

Research in the field of information retrieval and recommendation mostly focuses on one single evaluation method and one single quality …

Are you interested in attending my CHIIR 2020 tutorial on multi-method evaluation (Leveraging multiple methods to answer what you were looking for)? Consider preparing a small (very small!) task for the tutorial.

In our joint effort, advocating for multi-method evaluation, Eva Zangerle and me have set up a dedicated website: https://multimethods.info. On that page, we collect resources that help to apply multi-method evaluation in research and development.

I am happy to announce that I will give a tutorial with the title ‘‘Leveraging multiple methods to answer what you were looking for’’ at CHIIR 2020. Details will follow.

I am happy to announce that Martijn C. Willemsen and I organize tutor sessions in scope of the RecSys Summer School 2019. The idea is that each participant can discuss the specific research goals and questions with senior researchers/teachers of the summer school and fellow students.

I am happy to be a speaker at ACM Summer School on Recommender Systems taking place in Gothenburg, Sweden, just a week before the official RecSys 2019 in Copenhagen, Denmark.

Yesterday’s IUadaptME workshop at UMAP 2018 was a great success! Thank you to all participants and my co-organizers. We had interesting discussions. Ilknur Celik, Ilaria Torre, Frosina Koceva, Christine Bauer, Eva Zangerle, Bart Knijnenburg (2018).

The comprehensive evaluation of the performance of a system is a complex endeavor: many facets need to be considered in configuring an adequate and effective evaluation setting. A single evaluation method or measure is not able to evaluate all relevant aspects in a complex setting where a multitude of stakeholders are involved. Employing a multi-method evaluation, where multiple evaluation methods or measures are combined and integrated, allows for getting a richer picture and prevents blind spots in the evaluation outcome.

Together with Eva Zangerle and Bart Knijnenburg, I will organize a workshop on Multi-Method Evaluation of Personalized Systems (MuMe 2018) in scope of the 26th Conference on User Modeling, Adaptation and Personalization (UMAP 2018) in Singapore!