blindfold-test

Some Thoughts on Testing in Audio

Robert Brook runs a blog called The Broken Record, with a subtitle explaining that his blog is:

A GUIDE FOR THE DEDICATED ANALOG AUDIOPHILE

Some THOUGHTS on TESTING in AUDIO

My Two Cents

I made a couple of quick notes and sent them by email to Robert, as follows:

  • One record is not enough for this test, or any other for that matter, and
  • Tests need to be blinded.

Without blinding all you are doing is confirming your prejudices, which is something you correctly point out in your piece, and no matter how much you want to think you aren’t doing that because you are trying so hard to guard against it, it is almost surely what you will end up doing.

Confirmation bias is at the heart of most mistaken audio judgments, something I learned a very long time ago, and only after making every kind of mistake there is to make, over the course of decades no less. Only one thing had the power to set me on the right path, and without it I would never have learned how to make any real progress in audio, or find better sounding records for that matter.

If you don’t know how to run good experiments, how can you be sure your results are of any value?

(more…)

Our Filmed Tapestry Shootout Was a Real Shocker

Hot Stamper Pressings of the Music of Carole King Available Now

The Washington Post article that Geoff Edgers wrote includes a video of a little shootout we did for Tapestry, using, without my knowledge, the MoFi One-Step, a Hot Stamper pressing, and a current, modern, standard reissue of the album. Could I spot the Hot Stamper without knowing what record was playing?

First up (and of course unbeknownst to me), the MoFi. My impressions from the video:

That’s probably tonally correct for this record. It’s just missing everything that’s good about this record, which is a meaty, rich piano. And the vocal sounds very dry. There’s no Tubey Magic. It’s tonally correct. If you were playing me a CD right now, I wouldn’t be able to tell you weren’t. 

Next up, the cheap ($20?), current reissue:

Piano’s better.

Voice is better!

Richer and smoother.

That’s what this is supposed to sound like.

Her voice sounds mostly correct.

This might not be a particularly good record. If I played a real one for you, you might just say, oh, my God, there’s so much more.

But this is not a wrong record. It’s not awful. It’s doing something… I don’t know if I would say most things right. I’ll just say something right.

At least the person understands what she’s supposed to sound like.

Then the Hot Stamper (a Super Hot copy as it turns out):

She sounds pretty right on this copy.

I think there’s more space.

You hear more space, more three-dimensional space.

The piano: there’s more richness to the tone of the various notes that she’s playing.

I would probably pick this one.

Jeff sums it all up as follows:

So we have a winner, and I couldn’t fool the Hot Stamper king.

Without knowing what he was listening to, he chose the hot stamper of Tapestry.

If he still had it, that copy would be sold for about $400 on the Better Records website.

When we went back and played each of the pressings again, the differences were much more pronounced. The MoFi still sounded like a CD, the current Columbia reissue was still no better than passable, and the Hot Stamper became even better sounding than it had been earlier, with sound the other two could not begin to offer.

Our grades for the three pressings would have been F, C and A, in that order.

In the video, you can see that it took me a few minutes to get deep into the sound, but once I was there, it turned out to be no contest. The Hot Stamper was the only pressing capable of showing us just how good Tapestry can sound.

Colorations Are Bad Now?

The MoFi was by far the worst sounding of the three. As I said, it sounded to me like a CD.

(more…)

The Tapestry Shootout Video Is Here!

Geoff Edgers’ Washington Post article “The Search for the Perfect Sound,” in which he talks to lots of audiophiles and music lovers about his personal journey into the world of audiophile equipment and records, is now active on their website.

NEWSFLASH! This is currently the most popular story/video on the WAPO website! Number One with a bullet, baby. [Alas, no longer.]

Don’t miss the video below of yours truly doing a shootout for Tapestry.

It’s actually not a real shootout. For Tapestry we would typically play 8-10 early pressings and grade them for sound. This was more of a test, to see if I could spot the Hot Stamper among the pretenders, more What’s My Line than a shootout.

Part of the attraction of course is that I’m the guy they love to hate. Just check out the comments.

And please add some of your own. You are the only people on the planet qualified to talk about Hot Stampers because you are the only ones who have heard them on your own stereos with your own two ears.

Why should anyone care what somebody else has to say about something that that person has never experienced? The reason we stopped posting on the Hoffman website back in 2002 was simply the fact that I was tired of arguing with people that have strong opinions about the results of experiments they have never run.

Hot Stamper Shootouts are simply our way of doing blinded experiments on various pressings of records. We eschew theories and conjecture. We prefer observations and data. We write about these issues a lot here on the blog for those who would like to learn more about records. If you already know it all, this is probably not a blog you will find of much value.

I will be posting some comments soon, mostly about all the stuff that got left on the cutting room floor. We spent most of the time with some orange label Vertigo pressings of Dire Straits’ first album, finding a White Hot Stamper LP out of the batch we played, then comparing our records to the execrable Mobile Fidelity 45 RPM 2 disc pressings, pressings so bad they defy understanding. But that is another story for another day! (The MoFi was mastered by Krieg Wunderlich, so if you see his name in the credits of a record you may be interested in, don’t waste your money. He is hopelessly incompetent and can be counted on to produce some of the worst sounding audiophile records ever made.)

I had eye surgery on my right earlier on the day of the interview, so hopefully that accounts for some of my squinty appearance.

I have also been invited to participate in a Reddit Q&A sometime next week, discussing the issues raised in the article or video anyone would like to ask about, so stay tuned for that, and I hope you will participate as well.

Our customers have plenty of their own Hot Stamper stories to tell, and I hope to hear from some of you on that Reddit panel.

You are the only audiophiles with real, first-hand knowledge of what a Hot Stamper sounds like. Perhaps you will wish to share with other audiophiles what they don’t know they are missing.

And if you have any questions of any other kind, I hope you will give me a chance to answer them.

Just email tom@better-records.com

(more…)