If this a performance issue, would it be possible to separate these Datastores into different resource groups and back them up separately?
Does the SCV appliance have enough resources? Would you be able to increase the SCV OVA resources and see if that helps?
How long does your backups take to complete?