A Study of Evaluation Metrics for Recommender Algorithms

Date

2008-08-27

Advisors

Journal Title

Journal ISSN

ISSN

DOI

Volume Title

Publisher

Type

Conference

Peer reviewed

Yes

Abstract

There are inherent problems with evaluating the accuracy of recommender systems. Commonly-used metrics for recommender systems depend on the number of recommendations produced and the number of hidden items withheld, making it difficult to directly compare one system with another. In this paper we compare recommender algorithms using two datasets; the standard MovieLens set and an e-commerce dataset that has implicit ratings based on browsing behaviour. We introduce a measure that aids in the comparison and show how to compare results with baseline predictions based on random recommendation selections.

Description

Keywords

Citation

Redpath J., Glass D., McClean S., Chen L., (2008) A Study of Evaluation Metrics for Recommender Algorithms, In Proceedings of the 19th Irish Conference on Artificial Intelligence and Cognitive Science, pp.163--172, 2008

Rights

Research Institute

Cyber Technology Institute (CTI)