Heaters can take quite a bit of abuse, ±20% won't hurt them, of course if you can have them on the low side much better so tubes will last forever.
You could use 6.3V DC regulated, or 6V regulated will be fine, just a 7806 if the current needs aren't too high.
In both cases you should take some care to avoid noises, with the AC you can trim a center tap with a resistive divider to cancel hum. With DC you should be really careful about the noise of the rectifiers, cap surges and the ripple. If it isn't a very high gain preamp you may be better off with AC, much simpler to deal with.
JS