It's important.: any AC modulation of the polarization supply will (mostly) appear as a signal right on to the amplification stages. And due to the high impedances, even tiny noise currents can look like significant voltages.
However the high impedances also mean that very small capacitors make very good filters: at 100Meg, to get a 1Hz filter one only needs 5nF of capacitance. At 1Gig, it falls to 500pF.