Ignore focus when picking the color role.

This was a vestige from when the color group wasn't taken into
account (where focus does matter) and broke color selection with
"Inactive selection changes color" disabled in System Settings.