The authors do not work for, consult, own shares in or receive funding from any company or organization that would benefit from this article, and have disclosed no relevant affiliations beyond their academic appointment.
Online user reviews have come to play a crucial role in our decisions about which products to buy, what TV to watch, and what games to play.
But after initial enthusiasm, many platforms have pushed back against them. Netflix’s star ratings and written user reviews are a distant memory, and even YouTube no longer shows the number of “dislikes” a video receives.
Negativity in particular is a no-no. Instagram and Facebook will let you “like” a post, but if you dislike it they don’t want to know. Steam, the world’s largest distributor of PC games, has also struggled with negative reviews – in particular, co-ordinated negative campaigns known as “review bombing”.
However, in recent research published in The Internet and Higher Education we put a video game up for community review. After thousands of players and hundreds of written reviews we found that user feedback, properly managed, can lead to significant improvements.
One reason community reviews have become less popular is the rise of “review bombing”, the co-ordinated practice of leaving large numbers of negative user reviews on a game or product in order to reduce its aggregate review score.
Most review-bombing incidents appear to stem from more than just not enjoying a game. They may be driven by ideological disagreement with the content of the game or dislike of the actions of a developer.
Other times this activity is automated by bots to suppress media or send a warning to companies. To take one example, a gaming review YouTube channel called Gamer’s Nexus recently reported that one of its videos exposing a scam had received an attack of co-ordinated “dislikes”.
Gamer’s Nexus comment on the automated review bomb. Also, did you note that only the like counts are visible on this post?
Is removing reviews the answer?
When community reviews work, the consumer benefits by getting real-world information from the users of a product.
On YouTube, for example, the removal of dislike counts makes it hard to quickly assess the quality of a video. This is particularly important information for DIY or crafting videos.
The removal of dislikes also makes it more likely that a viewer will be caught out by clickbait, or tricked into watching a video that does not host the content promised.
When the system works
Our new study shows the advantages of community reviews. It demonstrates how, when handled carefully and objectively, community feedback can go a long way towards helping a game develop.
We made an educational game called The King’s Request for use in a medical and health sciences program. The aim was to crowdsource more feedback than we could get from students in our classes, so we released the game for free on Steam.
Of the 16,000 players, 150 provided written reviews. We analysed this feedback, which in many cases provided ideas and methods, to improve the game.
The King’s Request: a game that has been enhanced for learning through community reviews.
This is one example of where feedback from the gaming community, although opinionated in many cases, can genuinely help the development process, benefiting all stakeholders involved. This is particularly important as “serious” or educational games are a growing component of modern curriculums.
Censoring community reviews, even if the aim is to prevent misinformation, does make it harder for developers and educational designers to receive feedback, for viewers to receive quick information, and for paying customers to have their voice.
What is the future for community reviews?
The trend has been to remove negative community ratings. YouTube CEO Susan Wojcicki defended the removal of dislike counts earlier this year, and Netflix appears to have no interest in bringing back its five-star rating system.
However, not all outlets are following this trend. TikTok has been testing a dislike button for written contributions in a way that enables the community to filter out unhelpful posts.
TikTok argues that, once released, this will foster authentic engagement in the comment sections.