Have your say & ask the experts!

more 'snake oil'

431 replies [Last post]
cheeseboy
cheeseboy's picture
Offline
Joined: 17 Jul 2012
Posts: 313
RE: more 'snake oil'

ellisdj wrote:

I don't see why double blind matters... 

 

because it's one of the standard scientific basis of being able to say that the test you carried out was correct.  Without such things most tests would be deemed invalid. 

 

Not that I'm disputing that you heard differences, just saying that you might want to read up on what's considered "valid" testing for want of a better phrase.

__________________

Captain Duff
Captain Duff's picture
Offline
Joined: 26 Jul 2012
Posts: 112
RE: more 'snake oil'

Yes, absolutely agree with that. Double blind matters because as the blind tester on this thread makes clear he knew that something had been changed. There is then ample opportunity for a perceived 'placebo effect' to creep in. A double blind test could sniff that out quite easily by pretending to change things but actually leaving everything as it was and seeing if the listeners still perceive differences that they think should be there. You then do it enough times (along with standard ABX componant swapping) to make the results statistically vailid. The WHF 'blind' tests can be interesting, but I rarely if ever pay any real attention to them because they consistently use a flawed methodology.

Now in terms of the original post, I guess I have always had a hunch that for analogue signals a stable and vibration free environment is better than one that isn't. This is obvious for a TT, but I would accept that amps and interconnects could in a small way (and probably not one that you could detect) work better on a vibration free shelf. When it comes to digital sources I would seriously doubt that the 1's and 0's give a monkey's whether they are going though a pathway that doesn't move or one that is being used as a skipping rope - so long as the signal pathways remain clear all the way along. The exception to this rule would obviously be CD players where a certain relationship remains with a TT in the sense of having physical moving componants that benefit from not being shaken around...

__________________

Thorens 166 BC MkVI turntable, Origin Live Alliance tonearm, Goldring 2200 cartridge; Opera Consonance 120 Linear CD player; Denon DNP-720AE media player; Sugden Mystro amplifier; MS Aviano 8 speakers.

Biggerboat
Biggerboat's picture
Offline
Joined: 21 Sep 2012
Posts: 61
RE: more 'snake oil'

Most chart music sounds way better under 15 foot of cement when you're a continent away.  I imagine.

 

And the cheapest upgrade you can make to any system is to cup your hands behind your ears when listening to your music. Et voila - surround sound for free!

MajorFubar
MajorFubar's picture
Offline
Joined: 3 Mar 2010
Posts: 2347
RE: more 'snake oil'

Covenanter wrote:

If WhatHiFi want to gain credibility for their tests they need to be double blind or people like me will just ignore them.

Chris

According to ellisdj the listeners were told they were hearing three different systems.  Seeing that they actually weren't, yet they could still hear a difference, I'm not sure how WHF could have done it differently in order to make the results more valid.  Perhaps you could explain?  If you're skeptical about the results (skeptical as opposed to just being plain dismissive) then why don't you apply to be on a listeners' panel?  If you're just a plain 'atheist' and not at least an agnostic then don't bother; you've already convinced yourself there'll be no difference before you even sit down.

__________________

Main gear: Mac Mini > HRT Streamer II+ > Marantz PM66 KI > Mission 794

Also cluttering-up the place:

Thorens TD160 no cartridge; Marantz CD63 mkII KI; Technics SL-P777; Cyrus 2 + PSX; Cyrus Tuner; Nakamichi DR-1

cheeseboy
cheeseboy's picture
Offline
Joined: 17 Jul 2012
Posts: 313
RE: more 'snake oil'

MajorFubar wrote:

Covenanter wrote:

If WhatHiFi want to gain credibility for their tests they need to be double blind or people like me will just ignore them.

Chris

According to ellisdj the listeners were told they were hearing three different systems.  Seeing that they actually weren't, yet they could still hear a difference, I'm not sure how WHF could have done it differently in order to make the results more valid.  Perhaps you could explain?  If you're skeptical about the results (skeptical as opposed to just being plain dismissive) then why don't you apply to be on a listeners' panel?  If you're just a plain 'atheist' and not at least an agnostic then don't bother; you've already convinced yourself there'll be no difference before you even sit down.

 

eh?  No need to get so defensive when your own question was answered in the quote you responded to.  He's already said that whf could have conducted a double blind test to make the test more accurate and fair.

 

If you tell somebody they are going to hear 3 different systems then there is already a bias involved.

 

Perhaps they shouldn't have said anything and just left it at something like "we are going to play the same music 3 times, please let us know if you hear any difference", for example.

__________________

Biggerboat
Biggerboat's picture
Offline
Joined: 21 Sep 2012
Posts: 61
RE: more 'snake oil'

Psycho acoustic memory is so shockingly poor and these 'tests' so impossible to implement in any meaningful way, you might as well just go to the pub and ask the nearest drunk what he thinks.  At least you might get some jokes and casual sexism and racism thrown in.

cheeseboy
cheeseboy's picture
Offline
Joined: 17 Jul 2012
Posts: 313
RE: more 'snake oil'

Biggerboat wrote:

Psycho acoustic memory is so shockingly poor and these 'tests' so impossible to implement in any meaningful way, you might as well just go to the pub and ask the nearest drunk what he thinks.  At least you might get some jokes and casual sexism and racism thrown in.

 

now that's an issue I would love to see excellent!

__________________

ellisdj
ellisdj's picture
Offline
Joined: 11 Dec 2008
Posts: 513
RE: more 'snake oil'

I have said it was hard telling distinct differences between them - which is obvious now knowing it was the same system we was listening to.

I dont think it mattered that they told us it was 3 systems - either way if they said we are going to play a song 3 times can you hear a difference - you would still be listening for differences - so I would have had the same mindset to look for difference

The 3 systems were jumbled for every song - each song being a distinct test as they were all very different types of music

so a was not a in test 2 or 3, or maybe it was I dont know to make it fairer

They mentioned the idea about swopping the same one back in without telling us - however as the experience was new to us that would have made things more complicated - the test was desinged to be a simple as possibleto make it easier - its harder than you might think trust me

The fact I picked out the same system for each test as my preferred even though the letters didnt correspond to the same stand material shows I clearly preferred that presentation and it was in the presentation of the music where there was changes.

The test was a couple of hours only  and we all came up with different preferences based on our experiences so there was no right and wrong answer - I preferred the sound with the player straight on the floor - work that one out.

 

__________________

Meridian G61R, HD621, G55, MC200, MS600

Pioneer LX5090 Calibrated, Marantz UD7007, HIFi Racks Podium Reference

Monitor Audio GX100, GXC150, Apex A10, BK XLS400 (set with hard knee house curve)

Graham Slee Spatia (SC) Graham Slee Cusat 50 (IC x 5 Analogue,x 4 Digital)

professorhat
professorhat's picture
Offline
Joined: 28 Dec 2007
Posts: 10250
RE: more 'snake oil'

ellisdj wrote:

The test was a couple of hours only  and we all came up with different preferences based on our experiences so there was no right and wrong answer - I preferred the sound with the player straight on the floor - work that one out.

I think that's supposed to be the main take home from the Big Q tests - they're not meant to be scientific experiments, but a fun way to demonstrate that people can (and do) hear different things and, generally, people don't agree on what is "the best sound" i.e. go away, do your own listening tests and make your own mind up - don't just listen to what people tell you to do because "it's the best way".

If you want to do your own double blind listening tests at home, that's perfectly your choice, just as it's perfectly okay for someone to do sighted tests at home - whatever is your bag and whatever you enjoy. Some people don't find the idea of setting up scientifically valid experiments at home enjoyable. Others do. Remember that for most of us this is a hobby. It's meant to be fun!

 

plastic penguin
plastic penguin's picture
Offline
Joined: 28 Apr 2008
Posts: 12920
RE: more 'snake oil'

The Prof is right. When I was invited (in the early days) it was good fun and really interesting way of sharing opinions.

__________________

Leema Pulse MKII-S; Naim CD5i MKII; Denon TU-260L MKII; MA RS6 speakers; Pro-ject Xpression 1; loads of different cables...

 

Formerly known as plastic penguin

Biggerboat
Biggerboat's picture
Offline
Joined: 21 Sep 2012
Posts: 61
RE: more 'snake oil'

What the professor said, basically.

All this idea of 'testing' is complete nonsense really - If you listen to the same track three times in a row on the same kit,  you'll hear it differently each time. The brain picks different things to attune to and thats conditional on so many variables it's pointless even trying to nail it down and measure it.

The cable and the interconnect and the racks and the whatnot manufacturers all know this, of course, and so do you, and you all play along and turn 'double' blind eyes because it staves off the tedium and horror of life for a little while and keeps your hands and ears busy. And adds friction to the girlfriend and wife dynamic, of course, which is essential in perpetuating this merry dance we call existence. ;-)

Question to the bloke who was part of the What Hi-fi test - were you allowed to speak to the other guys doing the tests, did you have water to drink, how comfortable were the chairs, did you have breakfast beforehand, were you in a good mood? And so on.

Unless its absolutely scientifically provable, with data and charts and whatnot, forget it, its another bit of entertainment designed to rob your wallet. And fair play if you go along with it - I'm not judging anyone either way. 

 

chebby
chebby's picture
Offline
Joined: 2 Jun 2008
Posts: 13182
RE: more 'snake oil'

Biggerboat wrote:
...it staves off the tedium and horror of life for a little while...

Good slogan for a hi-fi manufacturer.

__________________

Marantz M-CR603 + AirPlay • Rega R3 loudspeakers • iPhone 5 32GB • iMac • Apple Airport Extreme 802.11n • Panasonic TX-L32D25B • Sony BDP-S390 • Ruark Audio R1 Deluxe • Humax HDR-Fox T2

professorhat
professorhat's picture
Offline
Joined: 28 Dec 2007
Posts: 10250
RE: more 'snake oil'

Biggerboat wrote:

What the professor said, basically.

All this idea of 'testing' is complete nonsense really - If you listen to the same track three times in a row on the same kit,  you'll hear it differently each time. The brain picks different things to attune to and thats conditional on so many variables it's pointless even trying to nail it down and measure it.

The cable and the interconnect and the racks and the whatnot manufacturers all know this, of course, and so do you, and you all play along and turn 'double' blind eyes because it staves off the tedium and horror of life for a little while and keeps your hands and ears busy. And adds friction to the girlfriend and wife dynamic, of course, which is essential in perpetuating this merry dance we call existence. ;-)

Question to the bloke who was part of the What Hi-fi test - were you allowed to speak to the other guys doing the tests, did you have water to drink, how comfortable were the chairs, did you have breakfast beforehand, were you in a good mood? And so on.

Unless its absolutely scientifically provable, with data and charts and whatnot, forget it, its another bit of entertainment designed to rob your wallet. And fair play if you go along with it - I'm not judging anyone either way. 

Well, perhaps not quite what I was trying to get across, but the part about live and let live is there I guess  Smile

Oh, and having been to a Big Q test, I can tell you that you are allowed to speak, you're offered drinks and you sit on a sofa. And Cardinal Ximénez wasn't poking me with a soft cushion at the time either.

 

Native_bon
Native_bon's picture
Offline
Joined: 26 Nov 2008
Posts: 571
RE: more 'snake oil'

Biggerboat wrote:

What the professor said, basically.

All this idea of 'testing' is complete nonsense really - If you listen to the same track three times in a row on the same kit,  you'll hear it differently each time. The brain picks different things to attune to and thats conditional on so many variables it's pointless even trying to nail it down and measure it.

The cable and the interconnect and the racks and the whatnot manufacturers all know this, of course, and so do you, and you all play along and turn 'double' blind eyes because it staves off the tedium and horror of life for a little while and keeps your hands and ears busy. And adds friction to the girlfriend and wife dynamic, of course, which is essential in perpetuating this merry dance we call existence. ;-)

Question to the bloke who was part of the What Hi-fi test - were you allowed to speak to the other guys doing the tests, did you have water to drink, how comfortable were the chairs, did you have breakfast beforehand, were you in a good mood? And so on.

Unless its absolutely scientifically provable, with data and charts and whatnot, forget it, its another bit of entertainment designed to rob your wallet. And fair play if you go along with it - I'm not judging anyone either way.

I had an experience with an iron & glass hifi stand i bought long time ago. I was told to change from my old target stand to the new stand, & that I will hear more detail. After setting up the stand then I sat down to listen.

Let me tell you my system sounded so bright. after just 3days the new system stand had to go.

I did this in studio enviroment so could hear the difference clearly. For me steel & glass stands are a no no from now on.

[EDITED BY MODS to clarify quote and response]

 

 

__________________

No rules. If it sounds good to you it sounds Right!!.Transpor:t . Oppo BDP-105EU Blue ray player.DAC: Rega dac & Audio lab M-Dac. AMP; MARANTZ SR7007. SPEAKER'S; SONUS FABER CREMONA'S. (FLOOR STANDING) SYSTEM STAND:QUADRASPIRE. INTERCONNECT;CHORD CHAMELEON SLIVER PLUS. DIGITAL CABLE:Clearer Audio silver Optimus. SPEAKER CABLES: RUSS ANDREWS CRYSTAL-24... Mains conditioner: Isol 8.

Computer: Yototech: 600T case: graphice GTX690 Graphics card. 32gb RAM. Processor: I7 3960X. Solid state drive. 500gb. Sata drive 2TB. blue ray drive. studio monitors: Yamaha SH80M Active speakers. Mixer: Presonus studiolive 16.0.2. Audio connection Firewire via presonus. Screen: Asus 27inch VG278H

relocated
relocated's picture
Offline
Joined: 20 Jan 2012
Posts: 803
RE: more 'snake oil'

chebby wrote:

Biggerboat wrote:
...it staves off the tedium and horror of life for a little while...

Good slogan for a hi-fi manufacturer.

 

rolling on the floor laughing     rolling on the floor laughing     rolling on the floor laughing

__________________

Apple Lossless - ATV3 - AVI ADM 40  or  Marantz CD50SE (modded] - AVI ADM 40

also ATV3 into AVI ADM 9T [my wife's system] and Grado SR80i