Properly split optional per-backend requirements
For now this is only used to reduce the dependencies generated by the debian packaging, but we could use that to better isolate per-backend tests too.
Test Plan
shouldn't affect testing
Migrated from D7280 (view on Phabricator)