That would work. You can then also snip the upstream caps as well. But you will need to adjust the resistors on the bases to accommodate the impedance change and you might need a zobel across the secondary. Technically you should try to figure out the optimal source impedance of the transistors and make sure it's not too much of a mismatch. But I don't think it would make too much of a difference. The higher Z could easily be a better match actually. It will bump up the gain by ~6db though so you might want to increase R5 slightly or the gain labels won't reflect reality or there's a slight possibility that you could get some instability at the max gain setting.