For audio measuring (THD, IMD, Freq. Response, etc...) there are basically 3 options, of which I've tried them all, and all are good options:
1st.- The best option IMHO, like pucho mentioned, get an old AP SYS-1, you'll want to buy a USB interface from Duke (Audio1Man here on GDIY) so it works on WIN10, unless you want to have an old windows 98 PC just to run it. With AP, the more features you want it to measure, the more it will cost, the basic units do freq. response and THD among other things like crosstalk, but if you want FFT and IMD you will need to pay more. Overall this option will cost you between $1K-$2.5K USD depending on which features you need. Be sure to be well informed on what you need to have an AP system running, there are a lot of things you need to take into account, again, Duke may offer some guidance. Also, the Sys-1 is bulky AF, so its not really meant to be moved around
2.- The intermediate option.- Get a QuantAsylum QA401, it does basically everything you'll ever need like IMD, THD, Sweep Freq Response, Power, FFT, Impedance, and more, it has similar specs to the AP SYS-1 and it costs around $500 USD, you can skip all the calibration since everything has been done for you just take it out of the box, plug it in and you are set to go. Its very portable.
3.- The cheap option, get a Scarlett 2i2 3rd Gen sound interface and download a copy of ARTA, REW, or whatever software you prefer, I've had no issues with this setup. Like squarewave said, sound cards these days are extremely good.
For electronic testing get a DMM or better yet, get 2, buy something from a reputable brand, doesn't have to be a Fluke but don't get the Chinese cheapy ones, specially if you are going to be working on high voltages, the recommendation I usually give is this
https://www.amazon.com/dp/B07W1BL3RH/?coliid=I8WT321QHXHJ9&colid=1L6ZIX9IE7HWU&psc=1&ref_=lv_ov_lig_dp_it
its an Amazon multimeter, yes Amazon makes multimeters now, actually no, apparently its made by a company called CEM which is a reputable brand and rebranded it for Amazon. But the meter is a bargain if you ask me, 6000 counts, IP67, True RMS, CAT IV, and can measure almost everything you'll need. I've seen reviews on Youtube and they all say this is a wonderful meter.
You will also want an oscilloscope, you can either buy a digital one or a used analog. For the digital scopes the usual low end brands are good Rigol, Siglent, Owon, Instek, Hammeg, etc.. I actually prefer buying a low end Tektronix which doesn't have as many feautres as the other brands I mentioned but it has the Tektronix name to back it up. I agree with squarewave, most low end scopes have a crappy FFT display, my Tektronix sucks for FFT. The scopes that have good FFT or spectrum analyzer are usually considerably more expensive.
You might also want to look at the Analog Discovery or Red Pitaya stuff, some people really like it, however, for audio I still prefer something like the QA401 and standalone gear.
If you are testing/designing your own gear, you may also want to buy a dual variable power supply, they are quite affordable and unless you are designing stuff like power amplifiers you don't need too much current capability.
And last but not least, buy a function generator, it can be the most simple one, I know that you can generate waveforms with your computer but its not as convenient as having a dedicated unit to do this.