Announcement

Collapse
No announcement yet.

Scope Creep - the complexity of reviewing

Collapse
X
Collapse
  •  

  • Scope Creep - the complexity of reviewing

    In the early period of my gaming experience, if someone asked me what a game was like, the answer was simple. “It’s great. The controls are good, there is lots to do, it takes two hours to complete and it takes four minutes to load. I didn’t encounter any bugs.”
    Click image for larger version

Name:	FindersKeepersC64.jpg.gif
Views:	1
Size:	9.0 KB
ID:	2743494
    Fast forward to today, and if someone asks me what a game is like, the answer is less simple. “It was good when I played it, but they keep changing it. I think it was rushed. There were bugs everywhere, but they might have fixed that by the time you play it. Enjoyment also depends on how much you are willing to spend on in-game purchases and power-ups. It takes 50 hours to see the main game through, so I’m only half way there, but there are an impossible number of side-quests that will keep you going till the end of time, so I can’t comment on those either.”
    Click image for larger version

Name:	1080N64.gif
Views:	1
Size:	127.7 KB
ID:	2743495
    So how did we get to this point? In the olden days (back when you had to get up out of your chair and press a button to change channels on your TV), you'd get a £1.99 Mastertronic game, load it, play it, tell others about it. Easy. You could guarantee that the experience that other gamers get is the same as you, as long as they had the same platform. If you are being really picky, I suppose you could say that those using a Konix Speedking might have a slightly different amount of fun. I’m all up for a bit of pedantry, but that’s really a step too far.

    Then came unoptimised 50hz PAL conversions, which were like playing in treacle when compared to their 60Hz NTSC “as designed” cousins overseas. However, if you never tried the 60Hz versions, you’d be happy enough and at least within region, one cart is going to provide the same game as the next cart.
    Click image for larger version

Name:	fez.jpg
Views:	1
Size:	52.1 KB
ID:	2743497
    The next layer of complexity was the addition of online multiplayer elements, which might work great when there are only 80 reviewers plus the dev / test team playing on the servers, but it might be different for users with poor connections or servers overloaded due to lack of stress testing (or just not caring about the initial first seven days of lunacy). Near the start of the time when action games became playable over the phone, the gaps in possible connections rates were huge, in terms of ping – anyone on an ISDN connection would have a large advantage over normal dial-up users, and if using dual-ISDN, the bandwidth gap was also large.

    Additionally a major problem is the limited number of players prior to the game release making it difficult for reviewers to play the multiplayer for long enough to judge the real longevity. Also, on less popular games, the multiplayer might be great, but if no one is connecting to play online three months after launch, it makes the review dated already.
    Click image for larger version

Name:	rdrdeathmatch.jpg
Views:	1
Size:	72.7 KB
ID:	2743496
    PC games have a whole additional consideration, lots of them allowing you to choose the level of detail and / or screen resolution depending in your setup. Playing Quake II on a Pentium? 120fps smoothness for the rocket-in-the-face win.

    The next phase was the addition of enough storage on consoles to allow bugs to be “patched” PC-style. At this point, what a reviewer sees might include game-breaking bugs that are then ironed out at launch so the user experience does not match the reviews, leaving everyone wondering why the reviews were so hideous (and seemingly wrong). Conversely, a patch might add bugs to a game.

    Finally (for now) came fundamental changes to the way the game is experienced - reviewers of Forza Motorsport 5 said it's too much of a chore to get the cars you want. Then Turn10 rolled out a patch that reduced the "price" of the cars substantially, so anyone buying after a certain point will have enjoyed a fairly different experience to the reviewers and early adopters. Incredibly, the game is further divided depending on how many previous Forza titles you have caned. I did the grind for a few days and got 600k credits. Then I got a "You played Forza 2 a bit" bonus of 3 Million credits! BUT…. It was a mixed blessing. Yes, it was initially exciting to get, but it made my feeble credit earning from actually PLAYING Forza 5 seem like pittance. The end result left me quite down about spending all that time grinding. It felt like I had engaged cheat mode and I hate cheat modes. So what did I do? I bought an expensive car, realised it was rubbish and the wrong choice and played Battlefield 4 instead. Which didn’t work in multiplayer properly until after two patch releases. It’s also worth noting that Battlefield takes time to mature – the casual players drop after a couple of months, leaving a much more team focused and helpful core userbase. If you reviewed it much later than release, you’d get a far better impression of the multiplayer madness.
    Click image for larger version

Name:	bf4.jpg
Views:	1
Size:	57.2 KB
ID:	2743498
    So while it’s great that some of these issues CAN now be addressed, it means that the best reviews to read when making a later-than-release purchase would be the most recent ones. Which goes directly against the “Must be FIRST!!11!!” mentality that pervades the game reporting interweblogsphere. It’s good to see some mainstream sites now insisting on waiting till just after release to publish their reviews to ensure they can check the real-world performance of each game’s support infrastructure, even though it must annoy publishers intensely. A solution is to go back and update reviews – not much fun for the reviewers though, who will have moved on to the next game on their list. The solution that works for me is to check the initial reviews and then read / contribute to the Bordersdown First Play threads for the latest sensationalist comments from excited readers.

    My Google+ Profile
      Posting comments is disabled.

    Categories

    Collapse

    Latest Articles

    Collapse

    • Translation: Boboboubo Boubobo (Menu screens)
      by Archives
      Here is a translation of the menu screens in Boboboubo Boubobo Dassutsu! Hajike Royale for the Nintendo Gamecube:

      Main Menu



      Story Mode
      "This is single player mode"
      "You can have fun in Story mode"
      Nose hair Training Centre
      "4 player battle, But only up to 4 players can play!"

      Secret Connection
      "Here you can connect a GBA cable to the Gamecube"

      Gallery "Here you can view Bobobo's files...
      22-08-2023, 13:33
    • Radiohead KID A MNESIA Exhibition - Report
      by Adrian Purser
      Appearing recently on digital storefronts, this digital exhibition coincides with the 20th anniversary re-release and bringing together of Radiohead's Kid A and Amnesiac albums. It's been made in collaboration between the band and Epic Games, though it's also very quick to tell you that it is not a game, epic or otherwise. That, I think, is a mixture of nervous expectation-setting, alongside its creators selling both games, and what they've created, short.
      Unless you're one of those sorts...
      04-01-2022, 16:56
    • Datel Freeloader Review - Action Replay Gamecube Region Free disc
      by Charles R
      Once upon a time, there was a Freeloader. It was late, as usual, but everyone waited with baited breath, because it promised much.

      And so it came to pass, the Freeloader finally arrived, and oh what gifts it brought. The ability to de-zone everyone's Gamecubes. Finally, an easy (and cheap) way for anyone in the world to play games from anywhere else in the world. It was welcomed with open arms.
      Datel, after many delays, have now released their de-zoning disc. Twice. The f...
      18-11-2015, 19:46
    • Goldeneye N64 Retrospective
      by Archives
      Describing the greatness of Goldeneye isn't the easiest task in the world. If you were to show it to a gamer who has recently been showered with PC First Person Shooters such as Far Cry, then they'd scoff at the low-polygon landscapes, the poor digitised textures of Robbie Coltrane and the frame rate equivalent to the IQ of a table leg. They'd be missing the point though, as levels such as "Surface" are the forebears to Far Cry's grand vistas.
      Which leads us nicely into one of the reaso...
      17-11-2015, 11:43
    • Fire Pro Wrestling Returns Translation Guide
      by Archives
      Here is a translation of the menu screens in:
      Fire Pro Wrestling Returns for the Sony Playstation2:

      Match Options Menu - appears before each match

      The selectable parts of these options all change, but we've translated what's in the screenshot anyway. Also this is a scroll menu and there's an option that doesn't appear on this screen unless you scroll, which is "Referee Select" (Left side) User Settings - 1 Blue Corner - 1P Red Corner - CP Match Rule -...
      06-11-2015, 15:07
    • TGS 2003 - Tokyo Game Show Report
      by Archives
      As a first visit to any kind of games show, it was going to be very interesting to see what all the fuss was about. I remember reading about the Tokyo Game Show among other shows in magazines years back and having a sense of delight and amazement. Did you ever dream of going to a game show in Japan? I'm sure it's something most avid gamers can associate with. On Sunday the 28th of September, my wife and I headed towards Makuhari messe from western Tokyo, a journey of 2 hours. When we finally ...
      22-05-2015, 17:34
    Working...
    X