Revert "only connect to worker signals when we've requested it" changes. It's too difficult to determine when to connect, causing a ton of regressions.

This will just have to be addressed in QApt2, when the time is right for that. In the meantime, this issue is just a bit annoying.