;D I actually used CMOS transfer gates (4016/4066) in a console to switch audio paths electronically back in the late '70s-early '80s.
If you look at how they work, the distortion mechanism is based on the TG's on resistance changing with terminal voltage, divided by the load impedance. I came up with a way to not only switch the audio in series with an opamp inverting input so the terminal voltage across the TG was almost nothing, but I also located the TGs inside the opamp feedback loop, so the current through the TG was also near zero. Even if there was distortion caused by the TG with almost no terminal voltage driving the very easy load of an opamp input, that distortion would be reduced by the loop gain margin of the opamp. Used this way, I was not able to detect any distortion from the switches, using the best bench equipment typical of the day (Sound Technology).
IIRC I ended up using a pair of TG per audio line I switched, and instead of just leaving a off input open circuit, I shunted the off input to ground to reduce any possible crosstalk. In fact the voltage and current inside the TGs is so small that the PCB layout is more influential to affect crosstalk than voltage crosstalk inside the TG packages. Another benefit of shunting the unused inputs to ground is it provides additional protection against input signals larger the +/- V/2 causing CMOS input diodes to conduct.
It was a minor PIA to come up with +/- V/2 rails just for the CMOS, but in the context of a console with 16x or 24x lines being switched it was a minimal expense. I also had to dial in timing and other tweaks to not make clicks while switching, but it worked well and was very clean.
JR
PS: It seems we have discussed this here also years ago... IIRC Brad also mentioned using TG in products to switch audio.