You do know the battery will put out a lot more current than your typical power supply? Even with big capacitors?

But you point is well taken.
If you use a car charger, keep the battery connected as well. It will clean up the charger's dirty power. Just do not use a charger that has a start the car mode.