If you can find them, mercury-wetted reed relays are very reliable. Inert-gas-filled regular reeds are almost as good if not abused.
Regular toggles are prone to adsorption of films on the contacts and consequent intermittency at low levels. They will drive you bonkers. They can be fine at first, then unruly things start to happen. If there is enough voltage in the circuit to zap through the films then you can be o.k., but low-level audio will not have that all the time.
Switches with some significant amount of wiping action can be pretty good---the old telephone-type leaf ones for example. But they are generally not sealed. So they are easier to clean but tend to get dirty faster.
Solid state will be reliable if not mistreated but will always have some limitations on signal swing, off isolation, distortion, etc.