In the end, we decided not to change the ways that players can review games, and instead focused on how potential purchasers can explore the review data. Starting today, each game page now contains a histogram of the positive to negative ratio of reviews over the entire lifetime of the game, and by clicking on any part of the histogram you're able to read a sample of the reviews from that time period. As a potential purchaser, it's easy to spot temporary distortions in the reviews, to investigate why that distortion occurred, and decide for yourself whether it's something you care about. This approach has the advantage of never preventing anyone from submitting a review, but does require slightly more effort on the part of potential purchasers.
It also has the benefit of allowing you to see how a game's reviews have evolved over time, which is great for games that are operating as services. One subtlety that's not obvious at first is that most games slowly trend downwards over time, even if they haven't changed in any way. We think this makes sense when you realize that, generally speaking, earlier purchasers of a game are more likely to enjoy it than later purchasers. In the pool of players who are interested in a game, the ones who are more confident that they'll like the game will buy it first, so as time goes on the potential purchasers left are less and less certain that they'll like the game. So if you see a game's reviews trending up over time, it may be an even more powerful statement about the quality of work its developers are doing.
Creston wrote on Sep 20, 2017, 11:31:
"We decided to do what is really the least amount of work for us."
Huzzah. Thanks Valve.
Frode wrote on Sep 20, 2017, 08:08:That's definitely an issue. It would be nice to have more options so the graph could be fine tuned.
My complaint about the graph is that the graph itself doesn't zoom to the selected area, so there are large areas of just a flat line due to the scaling from the amount of initial reviews.
Kxmode wrote on Sep 19, 2017, 23:09:I still wouldn't recommend No Man's Sky myself, but my one line review would be "No longer horrible, worth a look at heavy discount." It still has a lot of atrocious user interface and usability issues that gets in the way of playing the game, but the good news is there _is_ a game there now. That there was a spike around the latest content patch seems to indicate that many were waiting for that to happen.
I'm actually interested to see this on No Man's Sky.
We think this makes sense when you realize that, generally speaking, earlier purchasers of a game are more likely to enjoy it than later purchasers.