Avoid jumping to end of output when a modifier key (Control, Shift or Alt) is pressed on its own, as these keys are used to specify the selection mode.

This makes it easier to do block selection.