Explaining recommender systems fairness and accuracy through the lens of data characteristics

https://doi.org/10.1016/j.ipm.2021.102662Get rights and content
Under a Creative Commons license
open access

Highlights

  • Systematic analysis of impact of data characteristics on recommendation performance.

  • Regression-based explanatory modeling targeting accuracy and fairness metrics.

  • A minimum set of characteristics with maximum explanatory power is derived.

  • The amount of explainability achieved is larger for accuracy than fairness.

  • Injecting data biases in the model allows to improve explanatory power for fairness.

Abstract

The impact of data characteristics on the performance of classical recommender systems has been recently investigated and produced fruitful results about the relationship they have with recommendation accuracy. This work provides a systematic study on the impact of broadly chosen data characteristics (DCs) of recommender systems. This is applied to the accuracy and fairness of several variations of CF recommendation models. We focus on a suite of DCs that capture properties about the structure of the user–item interaction matrix, the rating frequency, item properties, or the distribution of rating values. Experimental validation of the proposed system involved large-scale experiments by performing 23,400 recommendation simulations on three real-world datasets in the movie (ML-100K and ML-1M) and book domains (BookCrossing). The validation results show that the investigated DCs in some cases can have up to 90% of explanatory power – on several variations of classical CF algorithms –, while they can explain – in the best case – about 40% of fairness results (measured according to user gender and age sensitive attributes). Therefore, this work evidences that it is more difficult to explain variations in performance when dealing with fairness dimension than accuracy.

Keywords

Explanatory power
Fairness
Accuracy
Collaborative filtering
Data characteristics

Cited by (0)