User credibility evaluation for reputation measurement of online service

Abstract

Purpose

Users often struggle to select choosing among similar online services. To help them make informed decisions, it is important to establish a service reputation measurement mechanism. User-provided feedback ratings serve as a primary source of information for this mechanism, and ensuring the credibility of user feedback is crucial for a reliable reputation measurement. Most of the previous studies use passive detection to identify false feedback without creating incentives for honest reporting. Therefore, this study aims to develop a reputation measure for online services that can provide incentives for users to report honestly.

Design/methodology/approach

In this paper, the authors present a method that uses a peer prediction mechanism to evaluate user credibility, which evaluates users’ credibility with their reports by applying the strictly proper scoring rule. Considering the heterogeneity among users, the authors measure user similarity, identify similar users as peers to assess credibility and calculate service reputation using an improved expectation-maximization algorithm based on user credibility.

Findings

Theoretical analysis and experimental results verify that the proposed method motivates truthful reporting, effectively identifies malicious users and achieves high service rating accuracy.

Originality/value

The proposed method has significant practical value in evaluating the authenticity of user feedback and promoting honest reporting.

Citation

Xiong, Y. and Fu, X. (2024), "User credibility evaluation for reputation measurement of online service", International Journal of Web Information Systems, Vol. 20 No. 2, pp. 176-194. https://doi.org/10.1108/IJWIS-12-2023-0247