It depends on the circuit. To visualize what is going on, the outer wrap of the capacitor foil if grounded, or tied to a low impedance node (like an op amp output), can act like a shield protecting the inside of the capacitor.
Best practice is for high impedance circuit nodes to connect to the inner wrap of the capacitor, with the outer wrap connected to a low impedance. Ambient noise will get sunk to ground or low Z by the effective shield.
Of course there are different topologies. Filters using grounded capacitors obviously get the outer wrap tied to ground. Capacitors across op amp NF paths get the outer wrap tied to the op amp output, inner wrap to op amp - input.
In many cases this does not make a big difference but why not do it right?
JR
PS: Back in my kit business days I used lots of (cheap) polystyrene caps. They all had clearly marked outer foil wrap ends.