Agreed. But there's no way of telling what audio information is lost and how it would be skewed in relation to amplitude or frequency. 'Lytics are primarily electro chemical devices with electrolyte in between 2 pieces of al foil. The electrolyte changes with time, along with charge migration as electrons find their way into the etched foil, which is a rather slow process (days, weeks, months) know as "forming". One of the reasons audio gear needs to "break in" before performing at its best.
But a pure filter does not lose information apart from that which it is designed to do. Practical implementations may introduce distortion (eg due to voltage coefficient). But tbh if you're using an electrolytic where that is an issue then you're doing it wrong.