Steam User Reviews Change

A post to the Steam Blog outlines changes coming to user reviews on Steam, something Valve hopes will address the growing trend of review bombing. The lengthy post includes a discussion of why review bombing is a problem and some of the possible solutions to this they considered before arriving at their game plan. Here's word on what they've ultimately decided to do about this:
In the end, we decided not to change the ways that players can review games, and instead focused on how potential purchasers can explore the review data. Starting today, each game page now contains a histogram of the positive to negative ratio of reviews over the entire lifetime of the game, and by clicking on any part of the histogram you're able to read a sample of the reviews from that time period. As a potential purchaser, it's easy to spot temporary distortions in the reviews, to investigate why that distortion occurred, and decide for yourself whether it's something you care about. This approach has the advantage of never preventing anyone from submitting a review, but does require slightly more effort on the part of potential purchasers.

It also has the benefit of allowing you to see how a game's reviews have evolved over time, which is great for games that are operating as services. One subtlety that's not obvious at first is that most games slowly trend downwards over time, even if they haven't changed in any way. We think this makes sense when you realize that, generally speaking, earlier purchasers of a game are more likely to enjoy it than later purchasers. In the pool of players who are interested in a game, the ones who are more confident that they'll like the game will buy it first, so as time goes on the potential purchasers left are less and less certain that they'll like the game. So if you see a game's reviews trending up over time, it may be an even more powerful statement about the quality of work its developers are doing.
View : : :
11 Replies. 1 pages. Viewing page 1.
Newer [  1  ] Older
11.
 
Re: Steam User Reviews Change
Sep 20, 2017, 23:19
11.
Re: Steam User Reviews Change Sep 20, 2017, 23:19
Sep 20, 2017, 23:19
 
Creston wrote on Sep 20, 2017, 11:31:
"We decided to do what is really the least amount of work for us."

Huzzah. Thanks Valve.

As a web developer, that graph didn't take "the least amount of work."
"Listen, Peter... with great horsepower comes... the sickest drifts..." - source
Avatar 18786
10.
 
Re: Steam User Reviews Change
Sep 20, 2017, 11:31
10.
Re: Steam User Reviews Change Sep 20, 2017, 11:31
Sep 20, 2017, 11:31
 
"We decided to do what is really the least amount of work for us."

Huzzah. Thanks Valve.
Avatar 15604
9.
 
Re: Steam User Reviews Change
Sep 20, 2017, 10:51
9.
Re: Steam User Reviews Change Sep 20, 2017, 10:51
Sep 20, 2017, 10:51
 
Fantastic idea, not fully implemented properly, should be able to scroll the graph to areas much like you do stocks.

Avatar 57660
8.
 
Re: Steam User Reviews Change
Sep 20, 2017, 08:32
8.
Re: Steam User Reviews Change Sep 20, 2017, 08:32
Sep 20, 2017, 08:32
 
Frode wrote on Sep 20, 2017, 08:08:
My complaint about the graph is that the graph itself doesn't zoom to the selected area, so there are large areas of just a flat line due to the scaling from the amount of initial reviews.
That's definitely an issue. It would be nice to have more options so the graph could be fine tuned.
Maybe even add tags to big bumps or dips.
  • Faulty Patch
    • New Version
      • Review Bombed
      • or allow the end user to mark up the graphs, but this is Valve we're talking about.
Avatar 58135
7.
 
Re: Steam User Reviews Change
Sep 20, 2017, 08:16
7.
Re: Steam User Reviews Change Sep 20, 2017, 08:16
Sep 20, 2017, 08:16
 

A truly decent addition to steam reviews.
I did not know that most games trend down over their life but that makes sense.
Avatar 58135
6.
 
Re: Steam User Reviews Change
Sep 20, 2017, 08:08
6.
Re: Steam User Reviews Change Sep 20, 2017, 08:08
Sep 20, 2017, 08:08
 
Kxmode wrote on Sep 19, 2017, 23:09:
I'm actually interested to see this on No Man's Sky.
I still wouldn't recommend No Man's Sky myself, but my one line review would be "No longer horrible, worth a look at heavy discount." It still has a lot of atrocious user interface and usability issues that gets in the way of playing the game, but the good news is there _is_ a game there now. That there was a spike around the latest content patch seems to indicate that many were waiting for that to happen.

My complaint about the graph is that the graph itself doesn't zoom to the selected area, so there are large areas of just a flat line due to the scaling from the amount of initial reviews.
5.
 
Re: Steam User Reviews Change
Sep 20, 2017, 02:01
5.
Re: Steam User Reviews Change Sep 20, 2017, 02:01
Sep 20, 2017, 02:01
 
No surprise that when one of their own games (DOTA2) gets reviewed bombed, they finally update the reviews system. A nice addition either way though.
Avatar 56178
4.
 
Re: Steam User Reviews Change
Sep 19, 2017, 23:16
4.
Re: Steam User Reviews Change Sep 19, 2017, 23:16
Sep 19, 2017, 23:16
 
It's live now, and you can check it out. Really interesting looking at that one. Seems people are liking that new update they put out.
3.
 
Re: Steam User Reviews Change
Sep 19, 2017, 23:09
3.
Re: Steam User Reviews Change Sep 19, 2017, 23:09
Sep 19, 2017, 23:09
 
We think this makes sense when you realize that, generally speaking, earlier purchasers of a game are more likely to enjoy it than later purchasers.

I'm actually interested to see this on No Man's Sky.
"Listen, Peter... with great horsepower comes... the sickest drifts..." - source
Avatar 18786
2.
 
Re: Steam User Reviews Change
Sep 19, 2017, 23:07
2.
Re: Steam User Reviews Change Sep 19, 2017, 23:07
Sep 19, 2017, 23:07
 
It is. And the graph itself is rather slick.
I think the 'hours played' stat should be a bit larger or bold. That's something I always look at when looking at reviews. I hate seeing something like 'best game ever! I play it every day!' and they have 1.6 hours on record. Sure, some of the time may be played in offline mode, but still.
Glad to see them tweaking it.
1.
 
Re: Steam User Reviews Change
Sep 19, 2017, 20:49
1.
Re: Steam User Reviews Change Sep 19, 2017, 20:49
Sep 19, 2017, 20:49
 
Wow... That's actually a really good feature...
Avatar 22996
11 Replies. 1 pages. Viewing page 1.
Newer [  1  ] Older