Week 10 Review: Immunizing Online Reputation Systems
One of the most popular websites to survive the dot com bubble burst was the online auction site eBay.com. It would seem that people like being able to buy and sell things directly with each other. One of the most important features of the site is it's reputation system which most people trust. Occasionally a news item appears on social news sites like Digg.com and Slashdot about an abuse of the ratings system but it's trusted overall. Chrysanthos Dellarocas, a professor at the Sloan School of Management at MIT, wrote a paper which discussed a few of the ways that such a ratings system can be abused. He identified 4 major types of abuse: ballot stuffing, or unfairly high ratings; bad-mouthing, or unfairly low ratings; negative discrimination, or when sellers provide good service to all but a few unliked customers; positive discrimination, or when sellers provide better service to preferred customers.
Chrysanthos identifies two major methods for combating these problems. Controlled anonymity would prevent ballot stuffing and bad-mouthing by keeping buyers from being able to provide ratings to people they knew. It would also likely prevent negative discrimination by keeping sellers from identifying buyer patterns. Unfortunately there are workarounds that people can use to get around anonymity so this solution sometimes fails. So instead the author recommends a "cluster" filtering solution which attempts to identify artificial inflation or deflation of ratings by targeting tight groups of ratings at abnormal distance from the average and eliminating them.
I think it would be extremely useful for eBay and other sites that rely on ratings to keep the user experience positive to implement a system like this. I think it would definitely improve the experience by removing the motivation to cheat the system.
Paper Cited: Immunizing Online Reputation Reporting Systems Against Unfair Ratings and Discriminatory Behavior [http://www.rhsmith.umd.edu/faculty/cdell/reputation.html]