Have your say & ask the experts!

Inconsistent reviewing

40 replies [Last post]
The_Lhc
The_Lhc's picture
Offline
Joined: 16 Oct 2008
Posts: 11218
RE: Inconsistent reviewing

RobinKidderminster wrote:
I carry all my devices in the car

"I'm sorry sir but I'm afraid I can't allow you to bring that car on my bus."

__________________

No signature worth mentioning...

Andrew Everard
Andrew Everard's picture
Offline
Joined: 30 May 2007
Posts: 29093
RE: Inconsistent reviewing

And no way will carrying all those gadgets affect the handling, sir...

__________________

Consulting Editor, What Hi-Fi? Sound and Vision/whathifi.com  Audio Editor, Gramophone

Alantiggger
Alantiggger's picture
Offline
Joined: 14 Oct 2007
Posts: 1419
RE: Inconsistent reviewing

The_Lhc wrote:

Preface: this is NOT an anti-Apple rant or any kind of accusation of bias, it's simply a request that reviews are more consistent. So:

 

Got the new issue through the post yesterday, flicked through the Smartphone group test, very interesting, won't spoil it because there'll be people that haven't read it yet but interesting result.

However... The HTC One X+ has a couple of things flagged as "Cons" against it, from memory, "average" battery life and no SD card slot.

Now, I wouldn't argue with that, if it weren't for the fact that the iPhone 5 has, according to the review, almost the same battery life (they're both quoted as being able to drain the battery within a day's hard use, actually seems quite optimistic to me) and NO SD card slot. Both phones (as tested) are 64GB devices and yet there's nothing in the iPhone "Cons" section about the battery or the card slot, suggesting that these aren't actually problems for the iPhone, only for the One X+, which seems a little unfair to me.

Would it be possible to make these tests a little more consistent? If something is an "issue" for one phone, then it must be for any other phone that shares the same "issue". I could understand if the One X+ only had 16GB of memory, for example but it doesn't, it has 64GB (and bear in mind the iPhone is available with only 16GB, would the lack of SD card slot be an issue then?).

I also understand that that isn't the reason the One X+ was docked a star.

For clarity, I own neither an iPhone or any member of the HTC One family, although I do own an older HTC phone.

So the answer to the OP is .......     puzzled

__________________

Lounge :  Samsung PS51E6500, Sony BDP S790, Virgin media XL, Onkyo  TX-SR508,

Tannoy Arena 5.1 with stands.(http://www.techradar.com/reviews/audio-visual/hi-fi-and-audio/hi-fi-and-av-speakers/tannoy-arena-96472/review)

Bed : Panasonic PX70 and a Sony BDP-370 Blu ray Player.

So far  :)

 

chebby
chebby's picture
Online
Joined: 2 Jun 2008
Posts: 13423
RE: Inconsistent reviewing

hammill wrote:
The_Lhc wrote:
RobinKidderminster wrote:
Sorry but for me the word phone is important. I would not dream of watching a movie on my phone. 

What about if you're on an 8 hour bus journey?

If I were on an 8 hour bus journey, I would need my head examining.

Last time I was on a train journey (sorry for the mention of public transport again Robin) from Portsmouth to Tiverton, I had good 3G coverage for 90 percent of the journey and thoroughly enjoyed catching up favourite programmes on iPlayer, surfing the web and reading the forum.

What would you expect me to do? Even reading a new copy of WHF? wouldn't occupy one past the first 20 miles now it's mostly photos, ads and buyers guide Smile

__________________

Marantz M-CR603 + AirPlay • Rega R3 loudspeakers • iPhone 5 32GB • iMac • Apple Airport Extreme 802.11n • Apple iPad Mini • Panasonic TX-L32D25B • Sony BDP-S390 • Ruark Audio R1 Deluxe • Humax HDR-Fox T2

Joe Cox
Joe Cox's picture
Online
Joined: 31 May 2007
Posts: 627
RE: Inconsistent reviewing

Firstly, we did mention the battery in the iPhone cons! "Battery life only so-so".

Secondly, the for, against and verdict - and indeed star rating - are only meant to be brief points pulled out from 500ish word reviews. So we wouldn't uniformly mention every pro/negative every time, more the highlights of each one on a case by case basis. Of course all the pros and cons, such as the lack of storage, would always be considered in our overall verdict on a product.

The iPhone has obviously never had a memory card slot so it's fair to say we might be more likely to assume a level of knowledge amongst readers – more so than on the HTC One X+ phone, which we'd expect fewer readers to know all about. 

__________________

Editor, whathifi.com

Twitter TheRealJoeCox

Google+ Joe Cox

hammill
hammill's picture
Online
Joined: 20 Mar 2008
Posts: 2101
RE: Inconsistent reviewing

chebby wrote:

hammill wrote:
The_Lhc wrote:
RobinKidderminster wrote:
Sorry but for me the word phone is important. I would not dream of watching a movie on my phone. 

What about if you're on an 8 hour bus journey?

If I were on an 8 hour bus journey, I would need my head examining.

Last time I was on a train journey (sorry for the mention of public transport again Robin) from Portsmouth to Tiverton, I had good 3G coverage for 90 percent of the journey and thoroughly enjoyed catching up favourite programmes on iPlayer, surfing the web and reading the forum.

What would you expect me to do? Even reading a new copy of WHF? wouldn't occupy one past the first 20 miles now it's mostly photos, ads and buyers guide Smile

Reading WHF used to take me 15 minutes, that is why I stopped buying it. Trains are not buses, even as a very car sick child I never felt unwell on a train and I might consider watching a blu-ray/dvd on my laptop on  a train (I have done on  a plane). I have travelled to Portsmouth by train on many occasions, but never from Tiverton - does it take 8 hours? I normally drive to the alps every year and the family listen to Stephen Fry reading Harry Potter in preference to the in car DVD player, ipods, DSs etc.

AnotherJoe
AnotherJoe's picture
Offline
Joined: 10 Jun 2011
Posts: 659
RE: Inconsistent reviewing

Actually the reviews in WhatApple are remarkably consistant.

 

Apple products (bar the AppleTV) never get marked down despite their shortcomings, whilst rivals can lose marks just for launching products on days that end in 'y'  poke, prod

 

__________________

Server Synology 8Bay DS1812+, Synology 4Bay DS412+, Sky+HD 

Lounge Samsung UE55D9000, Denon DBT-3313, Onkyo TX-NR5009, Tannoy Arena Highline 500 LCR, ACRyan playon!HD mini2 

Reception Samsung UE46C8000, Panasonic BDP310, Sony STR-DA5400ES, KEF2005.3, ACRyan playon!HD mini2 

Paul.
Paul.'s picture
Offline
Joined: 26 Nov 2010
Posts: 2433
RE: Inconsistent reviewing

In the 22 days I have owned my phone, I have made 3hrs and 40mins of calls.  Somehow, I have done over 189,000 meters in Temple Run, so pretty sure that took longer than 3:40! Maybe they should rename it iWastehugeamountsoftimeicouldbeusingtobeproductive5 to reflect its primary usage...

__________________

Paul's BR/805 system thread

(where the photos live) Paul's Flickr page

The_Lhc
The_Lhc's picture
Offline
Joined: 16 Oct 2008
Posts: 11218
RE: Inconsistent reviewing

Paul. wrote:
In the 22 days I have owned my phone, I have made 3hrs and 40mins of calls.  Somehow, I have done over 189,000 meters in Temple Run, so pretty sure that took longer than 3:40! 

I dunno, that geezer runs pretty fast!

__________________

No signature worth mentioning...

landzw
landzw's picture
Offline
Joined: 9 Jun 2009
Posts: 590
RE: Inconsistent reviewing

Maybe What HiFi could change the way it reviews. I really like another website that brakes down everything into different categorys like Build & Design, OS & Eco System, Battery Life & Performance, Value For Money etc and mark it out of 10 and then give an over all % because at the moment we don't get to see all this in the current What HiFi reviews.

You can still have What HiFi 5 star rating e.g

0 to 20% = 1 stars

21 to 40% = 2 star

41 to 60% = 3 stars

61 to 80% = 4 stars

81 to 100% = 5 stars

You could say anything that get 91 to 100% is a highly recommended, or something along those lines

 

__________________

My Cheap Cheerful Setup

LG 50PA650T , Sky HD , Sony BDPS185B , Xbox 360 , Sound Organisation AV Rack 

Yamaha MCR-555 , Shuffle With Bose SIE2 Sport Headphones

The_Lhc
The_Lhc's picture
Offline
Joined: 16 Oct 2008
Posts: 11218
RE: Inconsistent reviewing

To be fair the phone supertest does actually give more detailed scores out of 5 for different categories. I can't remember what they are though.

__________________

No signature worth mentioning...

Andy Clough
Andy Clough's picture
Offline
Joined: 27 Apr 2004
Posts: 5420
RE: Inconsistent reviewing

We give individual scores for picture, sound, build and features (p51).

__________________

Andy Clough is Brand Editor of What Hi-Fi? Sound and Vision and whathifi.com

jjbomber
jjbomber's picture
Offline
Joined: 22 Dec 2006
Posts: 452
RE: Inconsistent reviewing

You can hardly call it inconsistant as it's always fixed for the Rotten Fruit. If the Apple 5 is so good, why is the 5s already being road tested? It was the same with the i[pad3. that was so good it was pulled after just 6 months. Did any reviewers on the Apple payroll dare to critise them? Of course not. Apple products these days are dogs with fleas, simple as that. They remind me a lot of Nokia, who were once the kings of the mobile phone market but are now the also rans. Being the hypocrite i am, i still use a iphone 3gs, two ipod classics full of Dio and an ipod Touch. They deliver the best sound. Nothing else.

BenLaw
BenLaw's picture
Offline
Joined: 21 Nov 2010
Posts: 4243
RE: Inconsistent reviewing

jjbomber wrote:

If the Apple 5 is so good, why is the 5s already being road tested?

 

What a bizarre argument. Are you suggesting there won't be a new Nokia next year? A new Samsung? A new HTC?

__________________

HiFi   /   A/V   /   Bedroom

Andrew Everard
Andrew Everard's picture
Offline
Joined: 30 May 2007
Posts: 29093
RE: Inconsistent reviewing

jjbomber wrote:
Did any reviewers on the Apple payroll dare to critise them? Of course not.

I wasn't aware there were any reviewers on the Apple payroll.

__________________

Consulting Editor, What Hi-Fi? Sound and Vision/whathifi.com  Audio Editor, Gramophone