Perhaps I have a personal problem but after decades designing audio gear I have learned to not trust poorly designed listening tests (including my own), just too many ways to get it wrong. I find uncontrolled listening tests good for later in the design stage to check for something unanticipated and unexplored that wasn't metered.
Test equipment is only as good as the operator's experience and judgment. I'm still working on mine.
I find the esoteric audiophile community a poor source of scientific advances but there are rare exceptions. Jon Risch, the guy with the multi-tone IMD test is unquestionably an audiophile (trust me). So sometimes there's an intersection of that pursuit and actual useful engineering, while he has his share of detractors for some of his suggestions, I've found him mostly credible and he hasn't lost touch with engineering fundamentals.
JR
Test equipment is only as good as the operator's experience and judgment. I'm still working on mine.
I find the esoteric audiophile community a poor source of scientific advances but there are rare exceptions. Jon Risch, the guy with the multi-tone IMD test is unquestionably an audiophile (trust me). So sometimes there's an intersection of that pursuit and actual useful engineering, while he has his share of detractors for some of his suggestions, I've found him mostly credible and he hasn't lost touch with engineering fundamentals.
JR