The configuration of policy based VPN itself would not change when you use PBR.
But depending on what traffic you have on the 5 upstreams and where the source and destination is on the network, the contents of the tunnel traffic or the gateway to gateway tunnel traffic may be part of your PBR setup.
Policy based VPN inside tunnel traffic will not be able to be controlled with PBR as a route based tunnel could. So as long as you don't need to use PBR to choose the tunnels used then there should be no issue.
More likely the remote sites tunneling to this site are using upstream resources and this you could still control with PBR without changing the tunnel itself.