Nah, you won't lose any power. There's a lot of ******** being talked about back pressure.
If you retain the original front pipe, cat and centre but fit duplex sports back boxes, you will reduce the back pressure - but only enough to give you a power gain. A standard exhaust has most of the restriction in the back box, when you change this it's where most of the gain is made.
As long as you don't suddenly plumb in a 4" bore system including manifold, you won't affect it adversely. What's important is the gas speed, (not the back pressure) so the exhaust gas actually has enough inertia to help draw in the fresh fuel/air charge for the next burn. If you're keeping the standard front sections then you're not going to slow this down.