Check for contact manager being null and don't crash if it is.

I had a contact request, killed mc, accepted it and the whole kded didn't crash and the contact was still added. Double win.

Reviewed-by: David Edmundson